-- Logs begin at Fri 2022-06-24 15:38:16 UTC, end at Fri 2022-06-24 16:51:19 UTC. -- Jun 24 16:22:25.839030 dv-cinder-847189-3-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jun 24 16:22:25.846821 dv-cinder-847189-3-iscsi devstack@n-api.service[87433]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jun 24 16:22:25.848834 dv-cinder-847189-3-iscsi devstack@n-api.service[87433]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Jun 24 16:22:25 2022] *** Jun 24 16:22:25.848834 dv-cinder-847189-3-iscsi devstack@n-api.service[87433]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 24 16:22:25.848834 dv-cinder-847189-3-iscsi devstack@n-api.service[87433]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 24 16:22:25.848834 dv-cinder-847189-3-iscsi devstack@n-api.service[87433]: nodename: dv-cinder-847189-3-iscsi Jun 24 16:22:25.848834 dv-cinder-847189-3-iscsi devstack@n-api.service[87433]: machine: x86_64 Jun 24 16:22:25.848834 dv-cinder-847189-3-iscsi devstack@n-api.service[87433]: clock source: unix Jun 24 16:22:25.849257 dv-cinder-847189-3-iscsi devstack@n-api.service[87433]: pcre jit disabled Jun 24 16:22:25.849257 dv-cinder-847189-3-iscsi devstack@n-api.service[87433]: detected number of CPU cores: 4 Jun 24 16:22:25.849257 dv-cinder-847189-3-iscsi devstack@n-api.service[87433]: current working directory: / Jun 24 16:22:25.849257 dv-cinder-847189-3-iscsi devstack@n-api.service[87433]: detected binary path: /usr/bin/uwsgi-core Jun 24 16:22:25.849257 dv-cinder-847189-3-iscsi devstack@n-api.service[87433]: your processes number limit is 47680 Jun 24 16:22:25.849257 dv-cinder-847189-3-iscsi devstack@n-api.service[87433]: your memory page size is 4096 bytes Jun 24 16:22:25.849257 dv-cinder-847189-3-iscsi devstack@n-api.service[87433]: detected max file descriptor number: 2048 Jun 24 16:22:25.849257 dv-cinder-847189-3-iscsi devstack@n-api.service[87433]: lock engine: pthread robust mutexes Jun 24 16:22:25.849257 dv-cinder-847189-3-iscsi devstack@n-api.service[87433]: thunder lock: enabled Jun 24 16:22:25.849257 dv-cinder-847189-3-iscsi devstack@n-api.service[87433]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jun 24 16:22:25.849257 dv-cinder-847189-3-iscsi devstack@n-api.service[87433]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 24 16:22:25.894229 dv-cinder-847189-3-iscsi devstack@n-api.service[87433]: Python main interpreter initialized at 0x55ca4833d9c0 Jun 24 16:22:25.894229 dv-cinder-847189-3-iscsi devstack@n-api.service[87433]: python threads support enabled Jun 24 16:22:25.894229 dv-cinder-847189-3-iscsi devstack@n-api.service[87433]: your server socket listen backlog is limited to 100 connections Jun 24 16:22:25.894229 dv-cinder-847189-3-iscsi devstack@n-api.service[87433]: your mercy for graceful operations on workers is 90 seconds Jun 24 16:22:25.894598 dv-cinder-847189-3-iscsi devstack@n-api.service[87433]: mapped 403077 bytes (393 KB) for 2 cores Jun 24 16:22:25.894711 dv-cinder-847189-3-iscsi devstack@n-api.service[87433]: *** Operational MODE: preforking *** Jun 24 16:22:25.894969 dv-cinder-847189-3-iscsi devstack@n-api.service[87433]: *** uWSGI is running in multiple interpreter mode *** Jun 24 16:22:25.894969 dv-cinder-847189-3-iscsi devstack@n-api.service[87433]: spawned uWSGI master process (pid: 87433) Jun 24 16:22:25.895164 dv-cinder-847189-3-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jun 24 16:22:25.895724 dv-cinder-847189-3-iscsi devstack@n-api.service[87433]: spawned uWSGI worker 1 (pid: 87434, cores: 1) Jun 24 16:22:25.896059 dv-cinder-847189-3-iscsi devstack@n-api.service[87433]: spawned uWSGI worker 2 (pid: 87435, cores: 1) Jun 24 16:22:25.896224 dv-cinder-847189-3-iscsi devstack@n-api.service[87433]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 24 16:22:29.959396 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 24 16:22:29.960390 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 24 16:22:29.960390 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 24 16:22:29.960694 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 24 16:22:29.960946 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 24 16:22:29.961328 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:22:29.961652 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:22:29.961946 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 24 16:22:29.962349 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:22:29.962441 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 24 16:22:29.962521 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:22:29.962613 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:22:29.962726 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 24 16:22:29.962910 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:22:29.963021 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 24 16:22:29.963224 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:22:29.963319 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 24 16:22:29.963539 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:22:29.963630 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:22:29.963860 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:22:29.963962 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:22:29.964120 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:22:29.964242 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:22:29.964430 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:22:29.964543 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:22:29.964746 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-847189-3-iscsi {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:22:29.964867 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:22:29.965062 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:22:29.965175 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:22:29.965364 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:22:29.965492 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:22:29.965704 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:22:29.965895 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:22:29.966001 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:22:29.966222 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:22:29.966308 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:22:29.966481 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:22:29.966603 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:22:29.966814 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:22:29.966929 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:22:29.967135 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-847189-3-iscsi {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:22:29.967425 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:22:29.967824 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:22:29.967824 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:22:29.968043 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:22:29.968154 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:22:29.968276 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:22:29.968391 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:22:29.968494 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:22:29.968605 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:22:29.968752 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:22:29.968917 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:22:29.969050 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:22:29.969217 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:22:29.969352 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:22:29.969666 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:22:29.969753 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:22:29.969970 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:22:29.970078 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:22:29.970289 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:22:29.970374 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:22:29.970591 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:22:29.970684 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:22:29.970932 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-847189-3-iscsi {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:22:29.971036 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:22:29.971241 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:22:29.971332 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:22:29.971546 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:22:29.971630 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:22:29.971856 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:22:29.971953 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:22:29.972182 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:22:29.972327 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:22:29.972472 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:22:29.972566 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:22:29.972777 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:22:29.972863 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:22:29.973090 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-847189-3-iscsi {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:22:29.973181 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:22:29.973396 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:22:29.973489 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:22:29.973701 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:22:29.973795 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:22:29.974009 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:22:29.974092 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:22:29.974353 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:22:29.974445 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:22:29.974667 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:22:29.974814 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:22:29.975005 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:22:29.975105 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:22:29.975303 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:22:29.975389 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:22:29.975607 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:22:29.975703 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:22:29.975908 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:22:29.976001 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:22:29.976218 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:22:29.976307 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:22:29.976518 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:22:29.976609 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:22:29.976817 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:22:29.976902 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:22:29.977062 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:22:29.977163 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:22:29.977364 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:22:29.977448 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:22:29.977678 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:22:29.977770 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:22:29.977983 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:22:29.978080 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:22:29.978296 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:22:29.978382 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:22:29.978541 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:22:29.978625 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:22:29.978809 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:22:29.978914 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:22:29.979125 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:22:29.979211 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:22:29.979434 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:22:29.979568 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:22:29.979758 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:22:29.979872 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:22:29.980025 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:22:29.980113 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:22:29.980326 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:22:29.980413 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:22:29.980585 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:22:29.980671 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:22:29.980832 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:22:29.980918 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:22:29.981148 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:22:29.981246 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:22:29.981485 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:22:29.981571 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:22:29.981791 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:22:29.981876 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:22:29.982096 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:22:29.982189 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:22:29.982400 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:22:29.982486 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:22:29.982735 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:22:29.982825 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:22:29.983023 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:22:29.983126 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:22:29.983325 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:22:29.983419 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:22:29.983625 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:22:29.983712 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.18 {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:22:29.983928 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:22:29.984031 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.18 {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:22:29.984236 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:22:29.984327 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:22:29.984543 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:22:29.984627 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:22:29.984861 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:22:29.984954 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:22:29.985164 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:22:29.985249 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:22:29.985473 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:22:29.985556 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:22:29.985791 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:22:29.985887 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.18 {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:22:29.986093 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.18 {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:22:29.986184 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:22:29.986392 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:22:29.986491 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:22:29.986707 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:22:29.986802 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:22:29.987029 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:22:29.987114 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:22:29.987337 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:22:29.987420 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:22:29.987634 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:22:29.987727 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:22:29.987880 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:22:29.987973 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:22:29.988176 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:22:29.988274 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:22:29.988477 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:22:29.988564 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:22:29.988789 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:22:29.988874 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:22:29.989091 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:22:29.989181 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:22:29.989393 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:22:29.989481 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:22:29.989694 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:22:29.989779 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:22:29.989935 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:22:29.990028 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:22:29.990231 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:22:29.990317 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:22:29.990530 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:22:29.990616 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:22:29.990873 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:22:29.990974 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:22:29.991176 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:22:29.991260 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:22:29.991477 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:22:29.991568 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:22:29.991773 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:22:29.991873 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:22:29.992065 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:22:29.992148 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:22:29.992361 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:22:29.992455 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:22:29.992659 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:22:29.992746 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:22:29.992955 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:22:29.993039 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:22:29.993257 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:22:29.993342 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:22:29.993559 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:22:29.993646 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:22:29.993859 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:22:29.993941 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:22:29.994158 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:22:29.994240 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:22:29.994457 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:22:29.994544 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:22:29.994774 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:22:29.994865 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:22:29.995080 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:22:29.995175 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:22:29.995387 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:22:29.995498 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:22:29.995681 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:22:29.995804 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:22:29.995982 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:22:29.996068 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:22:29.996279 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:22:29.996374 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:22:29.996578 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:22:29.996662 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:22:29.996876 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:22:29.997470 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:22:29.997709 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:22:29.997828 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:22:29.998022 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:22:29.998252 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:22:29.998347 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:22:29.998605 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:22:29.998719 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:22:29.998944 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:22:29.999140 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:22:29.999234 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:22:29.999532 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:22:29.999617 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:22:29.999831 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:22:30.000036 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:22:30.000130 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:22:30.000413 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:22:30.000507 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:22:30.000711 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:22:30.000947 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:22:30.001040 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:22:30.001290 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:22:30.001374 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:22:30.001581 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:22:30.001788 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:22:30.001875 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:22:30.002194 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:22:30.002286 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:22:30.002498 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:22:30.002733 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:22:30.002836 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:22:30.003120 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:22:30.003213 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:22:30.003435 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:22:30.003595 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:22:30.003761 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.003903 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:22:30.004089 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.004207 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:22:30.004426 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.004512 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:22:30.004734 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.004832 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:22:30.005065 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.005153 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:22:30.005377 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:22:30.005468 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.005675 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:22:30.005762 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.005982 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.006069 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:22:30.006293 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.006380 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:22:30.006595 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:22:30.006681 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.006925 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:22:30.007019 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.007228 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:22:30.007316 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.007532 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.007619 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:22:30.007846 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.007931 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.008158 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.008243 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.008480 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.008567 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.008791 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.008875 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.009100 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.009202 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.009414 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.009500 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.009720 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.009822 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.010028 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.010124 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.010339 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.010425 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.010651 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.010805 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.010984 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.011117 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.011292 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.011378 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.011599 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.011684 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.011915 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.012014 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.012231 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.012317 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.012584 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.013214 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.013433 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.013530 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.013739 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.013832 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.014046 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.014140 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.014352 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.014446 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.014668 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.014819 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.015006 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.015101 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.015322 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.015414 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.015630 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.015722 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.015938 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.016068 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.016245 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.016333 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.016553 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.016639 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.016861 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.016946 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.017191 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.017278 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.017495 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.017581 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.017804 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.017903 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.018111 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.018206 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.018423 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.018508 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.018755 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.018858 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.019067 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.019155 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.019379 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.019465 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.019682 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.019779 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.019986 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.020073 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.020287 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.020373 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.020593 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.020696 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.020893 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.020985 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.021211 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.021304 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.021527 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.021622 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.021830 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.021955 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.022137 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.022223 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.022449 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.022542 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.022783 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.022872 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.023093 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.023327 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.023413 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.023691 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.023779 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.024000 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.024097 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.024302 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.024401 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.024621 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.024713 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.024926 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.025010 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.025225 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.025321 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.025545 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.025628 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.025845 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.025931 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.026148 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.026242 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.026458 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.026544 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.026787 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.026878 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.027099 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.027194 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.027406 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.027490 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.027708 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.027799 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.028020 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.028106 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.028353 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.028446 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.028658 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.028744 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.028980 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.029067 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.029288 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.029381 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.029592 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.029723 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.029910 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.029996 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.030217 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.030342 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.030516 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.030606 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.030849 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.031150 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.031249 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.031452 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.031596 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.031752 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.031966 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.032059 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.032342 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.032426 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.032643 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.032925 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.033013 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.033229 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.033477 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.033563 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.033832 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.034033 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.034121 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.034422 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.034635 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.034774 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.035037 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.035272 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.035359 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.035665 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.035831 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.035996 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.036307 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.036399 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.036629 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.036943 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.037034 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.037252 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.037554 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = None {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.037640 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.037854 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = None {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.037995 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.038161 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.038319 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.038480 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.038635 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.038877 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.038976 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.039189 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.039276 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.039491 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.039578 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.039798 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.039884 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.040114 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_vgpu_types = [] {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.040206 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.040441 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.040683 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.040769 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.041039 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.041249 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.041355 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.041662 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.041832 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.041966 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.042276 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.042408 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.042571 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.042895 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.043013 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.043202 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.043333 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.043511 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.043650 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.043855 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.043987 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.044162 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.044335 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.044462 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.044649 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.044772 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.044988 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.045082 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.045309 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.045401 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.045654 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.045834 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.045960 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.046160 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.046277 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.046476 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.046570 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.046808 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = None {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.046920 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.047119 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = None {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.047235 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.047434 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.047523 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.047822 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.047958 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.048139 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.048268 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.048443 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.048584 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.048743 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.048891 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.049042 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.049204 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.049339 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.049528 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_vgpu_types = [] {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.049677 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.049859 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.049983 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.050169 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.050285 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.050599 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.050721 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.050941 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.051029 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.051249 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.051348 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.051560 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.051646 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.051867 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.051952 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.052172 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.052260 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.052487 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.052580 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.052794 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.053045 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.053139 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.053362 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.053534 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.053707 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.053862 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.054017 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.054174 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.054323 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.054485 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.054635 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.054832 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.054969 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.055141 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.055274 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.055448 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.055577 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.055756 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.055887 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.056056 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.056206 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.056363 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.056516 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.056675 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.056834 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.057152 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.057236 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.057456 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.057565 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.057759 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.057875 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.058080 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.058170 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.058387 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.058473 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.058710 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.058816 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.059014 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.059121 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.059315 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.059960 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.060168 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.060265 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.060478 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.060564 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.060863 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.061073 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.061189 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.061380 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.061510 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.061683 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.061822 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.061993 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.062136 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.062297 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.062445 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.062600 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.062783 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.062928 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.063101 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.063237 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.063408 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.063538 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.063715 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.063841 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.064024 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.064143 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.064333 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.064444 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.064641 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.064757 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.064950 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.065044 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.065269 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.065355 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.065576 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.065669 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.065884 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.065970 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.066192 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.066278 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.066494 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.066634 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.066827 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.066917 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.067242 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.067327 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.067651 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.067822 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.067959 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.068157 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.068295 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.068473 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.068621 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.068787 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.068968 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.069105 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.069273 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.069431 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.069667 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.069799 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.070260 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.070505 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.070732 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.070855 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.071184 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.071611 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.071706 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.071928 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.072015 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.072242 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.072339 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.072547 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.072641 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.072859 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.072946 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.073171 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.073256 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.073478 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.073605 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.073773 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.073866 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.074119 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.074457 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.074552 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.075043 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.075743 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.076062 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.076159 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.076377 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.076471 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.076686 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.076770 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.076992 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.077084 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.077297 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.077383 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.077611 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.077696 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.077918 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.078004 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.078222 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.078315 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.078614 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.078950 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.079109 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.079610 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.079707 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.080007 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.080092 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.080315 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.080400 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.080624 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.080720 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.080938 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.081025 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.081263 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.081348 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.081582 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.081669 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.081891 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.081977 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.082242 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.082574 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.082667 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.082915 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.083164 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.083633 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.083723 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.083955 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.084092 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.084270 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.084365 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.084577 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.084663 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.084884 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.084977 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.085439 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.085526 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.085742 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.085835 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.086042 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.086127 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.086357 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.086444 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.086661 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.086803 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.086989 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.087080 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.087293 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.087379 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.087596 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.087681 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.087901 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.087984 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.088202 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.088289 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.088523 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.088611 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.088834 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.088937 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.089142 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.089255 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.089448 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.089534 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.089752 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.089847 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.090053 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.090140 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.090359 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.090447 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.090672 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.090883 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.091016 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.091103 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.091315 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.091407 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.091623 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.091722 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.091925 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.092010 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.092225 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.092310 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.092526 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.092621 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.092830 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.092927 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.093132 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.093225 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.093432 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.093519 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.093733 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.093825 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.094034 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.094120 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.094335 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.094422 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.094646 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.094747 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.094975 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.095070 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.095276 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.095370 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.095579 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.095666 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.095879 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.095965 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.096189 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.096275 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.096502 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.096588 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.096812 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.096906 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.097126 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.097222 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.097437 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.097523 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.097747 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.097840 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.098053 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.098138 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.098360 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.098444 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.098663 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.098826 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.098997 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.099083 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.099304 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.099389 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.099609 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.099707 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.099913 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.099998 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.100213 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.100298 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.100512 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.100610 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.100813 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.100951 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.101123 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.101242 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.101432 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.101555 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.101748 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.101867 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.102064 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.102157 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.102383 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.102470 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.102706 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.102796 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.103020 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.103115 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.103329 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.103417 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.103633 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.103721 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.103938 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.104079 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.104241 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.104393 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.104552 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.104708 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.104864 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.105016 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.105172 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.105319 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.105480 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.105622 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.105788 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.105933 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.106092 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.106254 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.106417 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.106577 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.106747 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.106906 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.107051 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.107208 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.107369 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.107527 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.107674 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.107831 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.107973 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.108149 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.108277 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.108563 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.108650 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.108872 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.108967 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.109173 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.109259 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.109580 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.109679 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.109887 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.109974 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.110193 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.110279 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.110492 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.110590 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.110824 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.110914 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.111138 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.111226 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.111439 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.111533 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.111750 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.111837 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.112051 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.112137 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.112368 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.112462 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.112685 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.112771 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.112995 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.113080 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.113306 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.113401 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.113608 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.113701 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.113927 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.114014 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.114233 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.114320 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.114545 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.114629 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.114869 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.114955 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.115174 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.115289 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.115476 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.115610 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.115797 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.115919 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.116102 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.116237 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.116420 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.116556 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.116830 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.116916 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.117137 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.117269 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.117440 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.117526 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.117739 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.117853 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.118041 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.118161 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.118360 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.118469 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.118666 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.118824 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.119001 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.119118 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.119308 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.119438 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.119611 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.119771 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.119915 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.120042 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.120215 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.120351 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.120534 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.120670 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.120835 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.120970 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.121153 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.121279 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.121465 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.121590 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.121781 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.121892 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.122617 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.122810 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.122949 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.123135 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.123269 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.123455 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.123577 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.123773 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.123872 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.124166 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.124251 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.124466 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.124552 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.124794 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.124887 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.125094 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.125179 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.125411 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.125496 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.125714 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.125807 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.126016 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.126109 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.126321 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.126407 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.126625 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.126753 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.126952 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.127039 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.127273 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.127362 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.127575 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.127663 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.127885 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.127972 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.128192 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.128287 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.128491 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.128577 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.128789 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.128873 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.129090 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.129176 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.129391 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.129478 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.129693 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.129778 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.130001 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.130101 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.130301 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.130394 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.130600 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.130706 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.130928 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.131014 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.131232 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.131320 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.131535 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.131622 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.131840 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.131932 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.132142 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.132274 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.132440 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.132552 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.132739 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.132826 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.133036 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.133130 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.133373 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.133459 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.133672 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.133764 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.133999 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.134094 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.134314 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.134401 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.134620 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.134725 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.134991 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.135127 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.135281 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.135370 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.135602 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.135688 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.135917 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.136054 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.136234 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.136322 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.136542 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.136626 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.136841 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.136929 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.137145 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.137267 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.137446 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.137549 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.138294 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.138391 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.138599 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.138704 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.138932 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.139022 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.139233 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.139322 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.139534 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.139620 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.139834 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.140062 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.140159 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.140391 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.140478 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.140705 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.140798 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.141017 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.141112 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.141327 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.141415 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.141630 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.141715 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.141932 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.142019 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.142240 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.142324 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.142548 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = False {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.142634 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.142880 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.142971 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.143190 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.143284 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.143508 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.143603 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.143831 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.143918 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.144137 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.144222 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.144457 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.144552 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.144773 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.144861 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.145083 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.145169 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.145394 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.145491 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.145708 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.145803 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.146022 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.146108 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.146337 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.146425 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.146650 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.146768 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.146980 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.147066 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.147294 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.147382 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.147603 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.147687 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.147913 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.148006 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.148224 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.148432 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.148540 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.148766 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.148853 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.149083 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.149178 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.149399 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.149486 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.149713 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.149806 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.150035 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.150129 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.150347 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.150433 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.150658 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.150806 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.150990 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = False {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.151086 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.151301 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.151431 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.151614 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.151744 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.151925 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.152014 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.152247 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.152441 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.152575 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.152752 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.152911 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.153082 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.153251 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.153444 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.153568 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.153764 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.153884 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.154085 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.154211 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.154416 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.154548 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.154765 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.154892 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.155071 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.155199 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.155376 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.155517 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.155683 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.155835 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.155989 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.156153 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.156291 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.156468 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.156609 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.156781 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.156919 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.157094 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.157223 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.157409 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.157540 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.157721 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.157845 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.158029 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.158342 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.158435 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.158652 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.158754 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.158998 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.159085 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.159338 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.159427 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.159658 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.159744 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.159971 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.160057 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.160278 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.160366 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.160590 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.160674 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.160897 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.161108 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.161204 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.161423 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.161549 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.161754 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.161841 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.162074 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.162162 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.162381 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.162467 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.162730 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.162821 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.163017 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.163118 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.163319 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.163406 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.163629 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.163723 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.163929 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.164016 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.164238 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.164324 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.164540 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.164626 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.164841 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.164927 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.165138 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.165222 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.165448 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.165534 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.165749 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.165837 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.166050 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.166136 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.166351 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.166446 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.166881 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.166983 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.167204 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.167348 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.167507 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.167594 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.167817 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.167904 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.168121 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.168215 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.168437 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.168534 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.168742 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.168848 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.169073 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.169160 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.169377 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.169477 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.169683 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.169769 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.169989 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.170075 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.170291 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.170379 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.170592 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.170722 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.170921 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.171020 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.171234 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.171322 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.171540 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.171674 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.171842 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.171930 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.172186 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.172281 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.172452 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.172538 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.172775 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.173001 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.173098 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.173333 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.173427 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.173653 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.173740 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.173959 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.174055 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.174262 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.174349 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.174563 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.174656 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.174889 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.174969 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.175211 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.175393 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.175533 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.175708 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.175842 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.176011 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.176152 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.176318 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.176460 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.176621 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.176767 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_native_luksv1 = False {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.176933 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.177075 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.177235 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.177381 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.177541 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.177687 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.177842 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.177993 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.178161 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.178304 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.178463 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.178610 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.178787 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.178942 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.179103 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.179249 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.rbd_volume_local_attach = False {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.179413 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.179556 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.179731 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.179867 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.180041 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.180206 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.180350 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.180524 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.180694 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.180839 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.181010 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.181152 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.181469 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.181562 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.181792 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.181885 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.182102 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.182198 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.182411 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.182498 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.182738 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.182838 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.183056 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.183181 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.183383 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.183472 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.183695 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.183782 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.183998 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.184093 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.184319 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.184922 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.185147 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.185459 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.185805 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_native_luksv1 = False {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.186112 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.186422 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.186756 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.186925 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.187067 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.187231 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.187374 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.187565 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.187683 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.187887 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.188016 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.188225 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.188313 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.rbd_volume_local_attach = False {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.188568 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.188663 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.188877 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.188962 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.189214 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.189303 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.189521 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.189606 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.189832 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.189927 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.190142 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.190228 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.190451 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.190544 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.190795 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.190946 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.191105 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.191201 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.191411 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.191506 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.191717 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.191813 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.192033 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.192119 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.192360 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.192447 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.192667 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.192766 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.192971 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.193056 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.193279 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.193371 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.193590 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.193678 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.193909 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.193995 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.194228 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.194314 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.194548 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.194637 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.194883 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.194971 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.195207 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.195292 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.195517 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.195605 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.195835 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.195922 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.196139 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.196227 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.196453 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.196540 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.196754 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.196845 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] database.use_db_reconnect = False {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.197063 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.197159 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] database.use_tpool = False {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.197393 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.197479 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.197706 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.197798 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.198024 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.198161 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.198333 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.198418 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.198653 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.198772 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.198987 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.199083 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.199297 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.199385 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.199608 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.199694 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.199917 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.200014 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.200813 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.200905 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.201133 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.201218 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.201441 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.201528 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.201753 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.201884 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.202061 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.202157 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.202367 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.202454 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.202673 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.202807 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.203006 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.203093 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.203306 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.203395 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.203623 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.203709 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.203932 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] database.use_db_reconnect = False {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.204017 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.204244 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] database.use_tpool = False {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.204332 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.204558 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.204643 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.204870 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.204963 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.205178 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.205265 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.205487 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.205572 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.205805 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.205943 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.206113 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.206198 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.206426 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.206512 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.206754 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.206858 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.207065 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.207153 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.207371 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.207469 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.207680 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.207774 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.207991 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.208076 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.208300 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.208387 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.208609 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.208698 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.208915 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.209003 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.209220 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.209306 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.209573 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.209667 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.209853 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.209941 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.210433 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.210526 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.210673 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=87434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 24 16:22:30.210779 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.211072 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.211386 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.211705 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.212017 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.212326 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.212647 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.212983 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.213394 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.213710 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.214074 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.214389 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.214742 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.215183 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.215508 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.215934 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.216261 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.216605 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.216971 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.217405 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.217734 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:22:30.217976 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=87435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 24 16:22:30.243901 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG oslo_db.sqlalchemy.engines [None req-9e546803-ed2e-4031-9302-95616fc3a87e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87434) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Jun 24 16:22:30.251834 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG oslo_db.sqlalchemy.engines [None req-938cad76-5760-449d-9faa-3eb5a140a1e4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87435) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Jun 24 16:22:30.492400 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.context [None req-9e546803-ed2e-4031-9302-95616fc3a87e None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),c009b6fd-523d-40a4-8f6f-3f0e03d98acc(cell1) {{(pid=87434) load_cells /opt/stack/nova/nova/context.py:464}} Jun 24 16:22:30.496670 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG oslo_concurrency.lockutils [None req-9e546803-ed2e-4031-9302-95616fc3a87e None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:22:30.498917 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG oslo_concurrency.lockutils [None req-9e546803-ed2e-4031-9302-95616fc3a87e None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=87434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:22:30.499725 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG oslo_concurrency.lockutils [None req-9e546803-ed2e-4031-9302-95616fc3a87e None None] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:22:30.501657 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG oslo_concurrency.lockutils [None req-9e546803-ed2e-4031-9302-95616fc3a87e None None] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=87434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:22:30.504667 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.context [None req-938cad76-5760-449d-9faa-3eb5a140a1e4 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),c009b6fd-523d-40a4-8f6f-3f0e03d98acc(cell1) {{(pid=87435) load_cells /opt/stack/nova/nova/context.py:464}} Jun 24 16:22:30.508837 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG oslo_concurrency.lockutils [None req-938cad76-5760-449d-9faa-3eb5a140a1e4 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:22:30.510453 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG oslo_concurrency.lockutils [None req-938cad76-5760-449d-9faa-3eb5a140a1e4 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=87435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:22:30.511289 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG oslo_concurrency.lockutils [None req-938cad76-5760-449d-9faa-3eb5a140a1e4 None None] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:22:30.513787 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG oslo_concurrency.lockutils [None req-938cad76-5760-449d-9faa-3eb5a140a1e4 None None] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=87435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:22:30.533459 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG oslo_db.sqlalchemy.engines [None req-9e546803-ed2e-4031-9302-95616fc3a87e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87434) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Jun 24 16:22:30.534469 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG oslo_db.sqlalchemy.engines [None req-9e546803-ed2e-4031-9302-95616fc3a87e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87434) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Jun 24 16:22:30.541821 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG oslo_db.sqlalchemy.engines [None req-938cad76-5760-449d-9faa-3eb5a140a1e4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87435) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Jun 24 16:22:30.553504 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG oslo_db.sqlalchemy.engines [None req-938cad76-5760-449d-9faa-3eb5a140a1e4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87435) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Jun 24 16:22:30.570307 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG oslo_db.sqlalchemy.engines [None req-9e546803-ed2e-4031-9302-95616fc3a87e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87434) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Jun 24 16:22:30.579741 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG oslo_db.sqlalchemy.engines [None req-938cad76-5760-449d-9faa-3eb5a140a1e4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87435) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Jun 24 16:22:30.739209 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: INFO keyring.backend [None req-9e546803-ed2e-4031-9302-95616fc3a87e None None] Loading KWallet Jun 24 16:22:30.740231 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: INFO keyring.backend [None req-938cad76-5760-449d-9faa-3eb5a140a1e4 None None] Loading KWallet Jun 24 16:22:30.842531 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: INFO keyring.backend [None req-9e546803-ed2e-4031-9302-95616fc3a87e None None] Loading SecretService Jun 24 16:22:30.843313 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: INFO keyring.backend [None req-938cad76-5760-449d-9faa-3eb5a140a1e4 None None] Loading SecretService Jun 24 16:22:30.846077 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 24 16:22:30.846077 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: from cryptography.utils import int_from_bytes Jun 24 16:22:30.846394 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 24 16:22:30.846394 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: from cryptography.utils import int_from_bytes Jun 24 16:22:30.846813 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 24 16:22:30.846813 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: from cryptography.utils import int_from_bytes Jun 24 16:22:30.847129 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 24 16:22:30.847129 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: from cryptography.utils import int_from_bytes Jun 24 16:22:30.847277 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: INFO keyring.backend [None req-9e546803-ed2e-4031-9302-95616fc3a87e None None] Loading Windows Jun 24 16:22:30.847831 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: INFO keyring.backend [None req-938cad76-5760-449d-9faa-3eb5a140a1e4 None None] Loading Windows Jun 24 16:22:30.848978 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: INFO keyring.backend [None req-9e546803-ed2e-4031-9302-95616fc3a87e None None] Loading chainer Jun 24 16:22:30.849676 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: INFO keyring.backend [None req-938cad76-5760-449d-9faa-3eb5a140a1e4 None None] Loading chainer Jun 24 16:22:30.849796 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: INFO keyring.backend [None req-9e546803-ed2e-4031-9302-95616fc3a87e None None] Loading macOS Jun 24 16:22:30.850454 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: INFO keyring.backend [None req-938cad76-5760-449d-9faa-3eb5a140a1e4 None None] Loading macOS Jun 24 16:22:31.097290 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: WARNING keystonemiddleware.auth_token [None req-938cad76-5760-449d-9faa-3eb5a140a1e4 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 24 16:22:31.098011 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: WARNING keystonemiddleware.auth_token [None req-9e546803-ed2e-4031-9302-95616fc3a87e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 24 16:22:31.103719 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: WARNING keystonemiddleware.auth_token [None req-938cad76-5760-449d-9faa-3eb5a140a1e4 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 24 16:22:31.104426 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: WARNING keystonemiddleware.auth_token [None req-9e546803-ed2e-4031-9302-95616fc3a87e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 24 16:22:31.316748 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: WARNING keystonemiddleware.auth_token [None req-938cad76-5760-449d-9faa-3eb5a140a1e4 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 24 16:22:31.317565 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: WARNING keystonemiddleware.auth_token [None req-9e546803-ed2e-4031-9302-95616fc3a87e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 24 16:22:31.321971 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: WARNING keystonemiddleware.auth_token [None req-938cad76-5760-449d-9faa-3eb5a140a1e4 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 24 16:22:31.322934 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: WARNING keystonemiddleware.auth_token [None req-9e546803-ed2e-4031-9302-95616fc3a87e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 24 16:22:31.327124 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55ca4833d9c0 pid: 87435 (default app) Jun 24 16:22:31.328071 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55ca4833d9c0 pid: 87434 (default app) Jun 24 16:22:31.329169 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi [None req-938cad76-5760-449d-9faa-3eb5a140a1e4 None None] Calling method '>' {{(pid=87435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:22:31.330278 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: INFO nova.api.openstack.requestlog [None req-938cad76-5760-449d-9faa-3eb5a140a1e4 None None] 10.222.0.18 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001647 Jun 24 16:22:31.330709 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: [pid: 87435|app: 0|req: 1/1] 10.222.0.18 () {50 vars in 788 bytes} [Fri Jun 24 16:22:31 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 16:23:51.203487 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi [None req-9e546803-ed2e-4031-9302-95616fc3a87e None None] Calling method '>' {{(pid=87434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:23:51.204614 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: INFO nova.api.openstack.requestlog [None req-9e546803-ed2e-4031-9302-95616fc3a87e None None] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001975 Jun 24 16:23:51.205019 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: [pid: 87434|app: 0|req: 1/2] 10.222.0.18 () {54 vars in 930 bytes} [Fri Jun 24 16:23:51 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 16:23:51.763852 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi [None req-9cabb5ca-3964-4cb5-bfee-7cbaeb7cd72e admin admin] Calling method '>' {{(pid=87435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:23:51.789437 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: INFO nova.api.openstack.requestlog [None req-9cabb5ca-3964-4cb5-bfee-7cbaeb7cd72e admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.577635 Jun 24 16:23:51.789963 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: [pid: 87435|app: 0|req: 2/3] 10.222.0.18 () {60 vars in 1291 bytes} [Fri Jun 24 16:23:51 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 16:23:53.999265 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi [None req-9e546803-ed2e-4031-9302-95616fc3a87e None None] Calling method '>' {{(pid=87434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:23:54.000268 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: INFO nova.api.openstack.requestlog [None req-9e546803-ed2e-4031-9302-95616fc3a87e None None] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001438 Jun 24 16:23:54.000672 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: [pid: 87434|app: 0|req: 2/4] 10.222.0.18 () {54 vars in 930 bytes} [Fri Jun 24 16:23:53 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 16:23:54.055846 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi [None req-c903d203-5b69-4eb9-ac39-e224a8414f65 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 256, "disk": 1, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "name": "cirros256", "id": "c1", "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=87435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 16:23:54.073515 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-flavor-manage:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 24 16:23:54.073515 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: warnings.warn(msg) Jun 24 16:23:54.099673 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: INFO nova.api.openstack.requestlog [None req-c903d203-5b69-4eb9-ac39-e224a8414f65 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.093220 Jun 24 16:23:54.100212 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: [pid: 87435|app: 0|req: 3/5] 10.222.0.18 () {64 vars in 1282 bytes} [Fri Jun 24 16:23:54 2022] POST /compute/v2.1/flavors => generated 407 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 24 16:23:54.431084 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi [None req-acff4d18-c44e-4992-be44-c8aefa04bff2 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=87434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 16:23:54.433422 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-flavor-extra-specs:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 24 16:23:54.433422 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: warnings.warn(msg) Jun 24 16:23:54.475921 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: INFO nova.api.openstack.requestlog [None req-acff4d18-c44e-4992-be44-c8aefa04bff2 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.367319 Jun 24 16:23:54.476485 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: [pid: 87434|app: 0|req: 3/6] 10.222.0.18 () {64 vars in 1335 bytes} [Fri Jun 24 16:23:54 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 16:23:56.663964 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi [None req-c903d203-5b69-4eb9-ac39-e224a8414f65 admin admin] Calling method '>' {{(pid=87435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:23:56.664966 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: INFO nova.api.openstack.requestlog [None req-c903d203-5b69-4eb9-ac39-e224a8414f65 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001418 Jun 24 16:23:56.665363 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: [pid: 87435|app: 0|req: 4/7] 10.222.0.18 () {54 vars in 930 bytes} [Fri Jun 24 16:23:56 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 16:23:56.772382 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi [None req-58ebdfd9-08d3-4eae-9b14-1028cc39bc6d admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "os-flavor-access:is_public": true, "swap": 0, "ram": 512, "name": "ds512M", "id": "d1", "vcpus": 1, "disk": 5, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=87434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 16:23:56.789578 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-flavor-manage:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 24 16:23:56.789578 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: warnings.warn(msg) Jun 24 16:23:56.813843 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: INFO nova.api.openstack.requestlog [None req-58ebdfd9-08d3-4eae-9b14-1028cc39bc6d admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.142068 Jun 24 16:23:56.814384 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: [pid: 87434|app: 0|req: 4/8] 10.222.0.18 () {64 vars in 1282 bytes} [Fri Jun 24 16:23:56 2022] POST /compute/v2.1/flavors => generated 404 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 16:23:56.825918 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi [None req-377ecd7e-58aa-48c7-a785-1fe744f7cf9c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=87435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 16:23:56.827434 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-flavor-extra-specs:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 24 16:23:56.827434 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: warnings.warn(msg) Jun 24 16:23:56.862537 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: INFO nova.api.openstack.requestlog [None req-377ecd7e-58aa-48c7-a785-1fe744f7cf9c admin admin] 10.222.0.18 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.040379 Jun 24 16:23:56.863122 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: [pid: 87435|app: 0|req: 5/9] 10.222.0.18 () {64 vars in 1335 bytes} [Fri Jun 24 16:23:56 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 16:23:59.026680 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi [None req-58ebdfd9-08d3-4eae-9b14-1028cc39bc6d admin admin] Calling method '>' {{(pid=87434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:23:59.028261 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: INFO nova.api.openstack.requestlog [None req-58ebdfd9-08d3-4eae-9b14-1028cc39bc6d admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002001 Jun 24 16:23:59.028653 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: [pid: 87434|app: 0|req: 5/10] 10.222.0.18 () {54 vars in 930 bytes} [Fri Jun 24 16:23:59 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 16:23:59.082423 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi [None req-4dd33a95-58e5-4162-87ee-aaa362bab198 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d2", "vcpus": 1, "swap": 0, "disk": 10, "rxtx_factor": 1.0, "ram": 1024, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds1G", "os-flavor-access:is_public": true}} {{(pid=87435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 16:23:59.106045 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: INFO nova.api.openstack.requestlog [None req-4dd33a95-58e5-4162-87ee-aaa362bab198 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.071608 Jun 24 16:23:59.106574 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: [pid: 87435|app: 0|req: 6/11] 10.222.0.18 () {64 vars in 1282 bytes} [Fri Jun 24 16:23:59 2022] POST /compute/v2.1/flavors => generated 404 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 24 16:23:59.117976 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi [None req-771722cf-e5a3-4e71-b08c-3fe5f62b6574 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=87434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 16:23:59.151195 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: INFO nova.api.openstack.requestlog [None req-771722cf-e5a3-4e71-b08c-3fe5f62b6574 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.036736 Jun 24 16:23:59.151734 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: [pid: 87434|app: 0|req: 6/12] 10.222.0.18 () {64 vars in 1335 bytes} [Fri Jun 24 16:23:59 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 16:24:01.298549 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi [None req-4dd33a95-58e5-4162-87ee-aaa362bab198 admin admin] Calling method '>' {{(pid=87435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:24:01.299580 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: INFO nova.api.openstack.requestlog [None req-4dd33a95-58e5-4162-87ee-aaa362bab198 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001463 Jun 24 16:24:01.299978 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: [pid: 87435|app: 0|req: 7/13] 10.222.0.18 () {54 vars in 930 bytes} [Fri Jun 24 16:24:01 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 16:24:01.354747 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi [None req-47943074-bf45-4bfb-8baa-7d1f8db026f9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "id": "d3", "ram": 2048, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "disk": 10, "vcpus": 2, "name": "ds2G"}} {{(pid=87434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 16:24:01.379498 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: INFO nova.api.openstack.requestlog [None req-47943074-bf45-4bfb-8baa-7d1f8db026f9 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.073864 Jun 24 16:24:01.380068 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: [pid: 87434|app: 0|req: 7/14] 10.222.0.18 () {64 vars in 1282 bytes} [Fri Jun 24 16:24:01 2022] POST /compute/v2.1/flavors => generated 404 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 16:24:01.391465 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi [None req-6cc028f9-c728-4cdb-8268-b8fc97ccadb3 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=87435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 16:24:01.425541 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: INFO nova.api.openstack.requestlog [None req-6cc028f9-c728-4cdb-8268-b8fc97ccadb3 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.037714 Jun 24 16:24:01.426111 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: [pid: 87435|app: 0|req: 8/15] 10.222.0.18 () {64 vars in 1335 bytes} [Fri Jun 24 16:24:01 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 16:24:03.580933 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi [None req-47943074-bf45-4bfb-8baa-7d1f8db026f9 admin admin] Calling method '>' {{(pid=87434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:24:03.581921 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: INFO nova.api.openstack.requestlog [None req-47943074-bf45-4bfb-8baa-7d1f8db026f9 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001416 Jun 24 16:24:03.582318 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: [pid: 87434|app: 0|req: 8/16] 10.222.0.18 () {54 vars in 930 bytes} [Fri Jun 24 16:24:03 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 16:24:03.637559 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi [None req-16687492-f684-4b88-9b06-35eb6d16f3b7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "disk": 20, "name": "ds4G", "ram": 4096, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 4, "id": "d4", "swap": 0, "os-flavor-access:is_public": true}} {{(pid=87435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 16:24:03.661004 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: INFO nova.api.openstack.requestlog [None req-16687492-f684-4b88-9b06-35eb6d16f3b7 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.072740 Jun 24 16:24:03.661543 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: [pid: 87435|app: 0|req: 9/17] 10.222.0.18 () {64 vars in 1282 bytes} [Fri Jun 24 16:24:03 2022] POST /compute/v2.1/flavors => generated 404 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 16:24:03.673559 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi [None req-2bd52359-43d4-4adb-a48a-9e63e1b0c328 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=87434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 16:24:03.707730 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: INFO nova.api.openstack.requestlog [None req-2bd52359-43d4-4adb-a48a-9e63e1b0c328 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.037829 Jun 24 16:24:03.708272 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: [pid: 87434|app: 0|req: 9/18] 10.222.0.18 () {64 vars in 1335 bytes} [Fri Jun 24 16:24:03 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 16:24:05.901131 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi [None req-16687492-f684-4b88-9b06-35eb6d16f3b7 admin admin] Calling method '>' {{(pid=87435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:24:05.902805 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: INFO nova.api.openstack.requestlog [None req-16687492-f684-4b88-9b06-35eb6d16f3b7 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001479 Jun 24 16:24:05.903212 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: [pid: 87435|app: 0|req: 10/19] 10.222.0.18 () {54 vars in 930 bytes} [Fri Jun 24 16:24:05 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 16:24:05.959086 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi [None req-21592c82-26ea-4237-afb1-7e5b3dafd913 admin admin] Calling method '>' {{(pid=87434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:24:05.981058 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: INFO nova.api.openstack.requestlog [None req-21592c82-26ea-4237-afb1-7e5b3dafd913 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.071066 Jun 24 16:24:05.981579 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: [pid: 87434|app: 0|req: 10/20] 10.222.0.18 () {60 vars in 1291 bytes} [Fri Jun 24 16:24:05 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 16:24:08.160517 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi [None req-16687492-f684-4b88-9b06-35eb6d16f3b7 admin admin] Calling method '>' {{(pid=87435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:24:08.161465 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: INFO nova.api.openstack.requestlog [None req-16687492-f684-4b88-9b06-35eb6d16f3b7 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001435 Jun 24 16:24:08.161855 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: [pid: 87435|app: 0|req: 11/21] 10.222.0.18 () {54 vars in 930 bytes} [Fri Jun 24 16:24:08 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 16:24:08.220255 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi [None req-2fb3685c-8346-4205-9041-e839aa2aec6d admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "ram": 512, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.tiny", "id": "1", "disk": 1, "vcpus": 1, "swap": 0, "rxtx_factor": 1.0}} {{(pid=87434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 16:24:08.245427 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: INFO nova.api.openstack.requestlog [None req-2fb3685c-8346-4205-9041-e839aa2aec6d admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.077684 Jun 24 16:24:08.245965 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: [pid: 87434|app: 0|req: 11/22] 10.222.0.18 () {64 vars in 1282 bytes} [Fri Jun 24 16:24:08 2022] POST /compute/v2.1/flavors => generated 402 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 16:24:08.257303 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi [None req-56d6af49-1100-4b61-8515-43d051f26238 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=87435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 16:24:08.299439 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: INFO nova.api.openstack.requestlog [None req-56d6af49-1100-4b61-8515-43d051f26238 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.045611 Jun 24 16:24:08.300011 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: [pid: 87435|app: 0|req: 12/23] 10.222.0.18 () {64 vars in 1332 bytes} [Fri Jun 24 16:24:08 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 16:24:10.463121 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi [None req-2fb3685c-8346-4205-9041-e839aa2aec6d admin admin] Calling method '>' {{(pid=87434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:24:10.464100 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: INFO nova.api.openstack.requestlog [None req-2fb3685c-8346-4205-9041-e839aa2aec6d admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001429 Jun 24 16:24:10.464491 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: [pid: 87434|app: 0|req: 12/24] 10.222.0.18 () {54 vars in 930 bytes} [Fri Jun 24 16:24:10 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 16:24:10.519807 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi [None req-f38b2ae6-e8a6-44f8-aac6-c75d58d54619 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.small", "disk": 20, "swap": 0, "os-flavor-access:is_public": true, "id": "2", "vcpus": 1, "rxtx_factor": 1.0, "ram": 2048}} {{(pid=87435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 16:24:10.542224 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: INFO nova.api.openstack.requestlog [None req-f38b2ae6-e8a6-44f8-aac6-c75d58d54619 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.071994 Jun 24 16:24:10.542792 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: [pid: 87435|app: 0|req: 13/25] 10.222.0.18 () {64 vars in 1282 bytes} [Fri Jun 24 16:24:10 2022] POST /compute/v2.1/flavors => generated 405 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 16:24:10.554090 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi [None req-b8acf79f-122b-49e7-87a9-0f14153289e5 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=87434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 16:24:10.588271 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: INFO nova.api.openstack.requestlog [None req-b8acf79f-122b-49e7-87a9-0f14153289e5 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.037700 Jun 24 16:24:10.588807 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: [pid: 87434|app: 0|req: 13/26] 10.222.0.18 () {64 vars in 1332 bytes} [Fri Jun 24 16:24:10 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 16:24:12.755064 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi [None req-f38b2ae6-e8a6-44f8-aac6-c75d58d54619 admin admin] Calling method '>' {{(pid=87435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:24:12.756088 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: INFO nova.api.openstack.requestlog [None req-f38b2ae6-e8a6-44f8-aac6-c75d58d54619 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001471 Jun 24 16:24:12.756470 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: [pid: 87435|app: 0|req: 14/27] 10.222.0.18 () {54 vars in 930 bytes} [Fri Jun 24 16:24:12 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 16:24:12.812729 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi [None req-3bce10b3-af76-473e-946c-a939be5d87b0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.medium", "swap": 0, "id": "3", "ram": 4096, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "disk": 40, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 2}} {{(pid=87434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 16:24:12.835936 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: INFO nova.api.openstack.requestlog [None req-3bce10b3-af76-473e-946c-a939be5d87b0 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.073132 Jun 24 16:24:12.836473 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: [pid: 87434|app: 0|req: 14/28] 10.222.0.18 () {64 vars in 1282 bytes} [Fri Jun 24 16:24:12 2022] POST /compute/v2.1/flavors => generated 406 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 24 16:24:12.848847 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi [None req-6eaf8ab6-669c-4498-8ce2-f1229658fad5 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=87435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 16:24:12.882440 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: INFO nova.api.openstack.requestlog [None req-6eaf8ab6-669c-4498-8ce2-f1229658fad5 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.037228 Jun 24 16:24:12.883017 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: [pid: 87435|app: 0|req: 15/29] 10.222.0.18 () {64 vars in 1332 bytes} [Fri Jun 24 16:24:12 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 16:24:15.034378 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi [None req-3bce10b3-af76-473e-946c-a939be5d87b0 admin admin] Calling method '>' {{(pid=87434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:24:15.035415 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: INFO nova.api.openstack.requestlog [None req-3bce10b3-af76-473e-946c-a939be5d87b0 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001464 Jun 24 16:24:15.035818 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: [pid: 87434|app: 0|req: 15/30] 10.222.0.18 () {54 vars in 930 bytes} [Fri Jun 24 16:24:15 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 16:24:15.091248 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi [None req-de753d94-b313-4872-9812-58b2ea601df3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 8192, "id": "4", "os-flavor-access:is_public": true, "name": "m1.large", "vcpus": 4, "disk": 80, "swap": 0, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=87435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 16:24:15.113798 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: INFO nova.api.openstack.requestlog [None req-de753d94-b313-4872-9812-58b2ea601df3 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.072151 Jun 24 16:24:15.114346 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: [pid: 87435|app: 0|req: 16/31] 10.222.0.18 () {64 vars in 1282 bytes} [Fri Jun 24 16:24:15 2022] POST /compute/v2.1/flavors => generated 405 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 16:24:15.126378 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi [None req-e7bf4f37-81d6-4312-b368-556c131fa013 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=87434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 16:24:15.159893 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: INFO nova.api.openstack.requestlog [None req-e7bf4f37-81d6-4312-b368-556c131fa013 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.037113 Jun 24 16:24:15.160437 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: [pid: 87434|app: 0|req: 16/32] 10.222.0.18 () {64 vars in 1332 bytes} [Fri Jun 24 16:24:15 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 16:24:17.333825 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi [None req-de753d94-b313-4872-9812-58b2ea601df3 admin admin] Calling method '>' {{(pid=87435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:24:17.334853 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: INFO nova.api.openstack.requestlog [None req-de753d94-b313-4872-9812-58b2ea601df3 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001417 Jun 24 16:24:17.335248 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: [pid: 87435|app: 0|req: 17/33] 10.222.0.18 () {54 vars in 930 bytes} [Fri Jun 24 16:24:17 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 16:24:17.391976 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi [None req-04a813f7-b924-49f9-b314-08917629678d admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 16384, "name": "m1.xlarge", "id": "5", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "rxtx_factor": 1.0, "disk": 160, "os-flavor-access:is_public": true, "vcpus": 8}} {{(pid=87434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 16:24:17.414482 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: INFO nova.api.openstack.requestlog [None req-04a813f7-b924-49f9-b314-08917629678d admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.072990 Jun 24 16:24:17.415054 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: [pid: 87434|app: 0|req: 17/34] 10.222.0.18 () {64 vars in 1282 bytes} [Fri Jun 24 16:24:17 2022] POST /compute/v2.1/flavors => generated 408 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 16:24:17.426513 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi [None req-4d5a0030-dbd7-4700-825c-7a61a54e177e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=87435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 16:24:17.460504 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: INFO nova.api.openstack.requestlog [None req-4d5a0030-dbd7-4700-825c-7a61a54e177e admin admin] 10.222.0.18 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.037599 Jun 24 16:24:17.461053 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: [pid: 87435|app: 0|req: 18/35] 10.222.0.18 () {64 vars in 1332 bytes} [Fri Jun 24 16:24:17 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 16:25:24.177936 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi [None req-04a813f7-b924-49f9-b314-08917629678d admin admin] Calling method '>' {{(pid=87434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:25:24.178956 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: INFO nova.api.openstack.requestlog [None req-04a813f7-b924-49f9-b314-08917629678d admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001427 Jun 24 16:25:24.179355 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: [pid: 87434|app: 0|req: 18/36] 10.222.0.18 () {54 vars in 930 bytes} [Fri Jun 24 16:25:24 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 16:25:24.236014 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi [None req-150eac09-f487-401a-9f4e-f6ae7d0b4704 admin admin] Calling method '>' {{(pid=87435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:25:24.258514 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: INFO nova.api.openstack.requestlog [None req-150eac09-f487-401a-9f4e-f6ae7d0b4704 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.072467 Jun 24 16:25:24.259063 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: [pid: 87435|app: 0|req: 19/37] 10.222.0.18 () {60 vars in 1291 bytes} [Fri Jun 24 16:25:24 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 16:25:25.706199 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi [None req-04a813f7-b924-49f9-b314-08917629678d admin admin] Calling method '>' {{(pid=87434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:25:25.707205 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: INFO nova.api.openstack.requestlog [None req-04a813f7-b924-49f9-b314-08917629678d admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001428 Jun 24 16:25:25.707599 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: [pid: 87434|app: 0|req: 19/38] 10.222.0.18 () {56 vars in 1074 bytes} [Fri Jun 24 16:25:25 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 16:25:25.893289 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi [None req-541e5c47-2366-454a-952f-99557bd64f78 admin admin] Calling method '>' {{(pid=87435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:25:25.906031 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: INFO nova.api.openstack.wsgi [None req-541e5c47-2366-454a-952f-99557bd64f78 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jun 24 16:25:25.906597 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi [None req-541e5c47-2366-454a-952f-99557bd64f78 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=87435) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jun 24 16:25:25.907412 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: INFO nova.api.openstack.requestlog [None req-541e5c47-2366-454a-952f-99557bd64f78 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.88 time: 0.063304 Jun 24 16:25:25.907919 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: [pid: 87435|app: 0|req: 20/39] 10.222.0.18 () {60 vars in 1190 bytes} [Fri Jun 24 16:25:25 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 24 16:25:25.917373 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi [None req-f49930aa-4af4-47cc-bf72-db1f92232a26 admin admin] Calling method '>' {{(pid=87434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:25:25.936679 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: INFO nova.api.openstack.requestlog [None req-f49930aa-4af4-47cc-bf72-db1f92232a26 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.88 time: 0.022862 Jun 24 16:25:25.937198 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: [pid: 87434|app: 0|req: 20/40] 10.222.0.18 () {60 vars in 1210 bytes} [Fri Jun 24 16:25:25 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 16:25:25.946709 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi [None req-647de4dc-6126-47c7-b37c-0bcee617296c admin admin] Calling method '>' {{(pid=87435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:25:25.967599 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: INFO nova.api.openstack.requestlog [None req-647de4dc-6126-47c7-b37c-0bcee617296c admin admin] 10.222.0.18 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.88 time: 0.024322 Jun 24 16:25:25.968125 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: [pid: 87435|app: 0|req: 21/41] 10.222.0.18 () {60 vars in 1210 bytes} [Fri Jun 24 16:25:25 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 16:25:25.977368 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi [None req-83a21deb-1cb3-4821-add7-2872f3081f56 admin admin] Calling method '>' {{(pid=87434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:25:25.989416 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: INFO nova.api.openstack.wsgi [None req-83a21deb-1cb3-4821-add7-2872f3081f56 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jun 24 16:25:25.989988 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi [None req-83a21deb-1cb3-4821-add7-2872f3081f56 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=87434) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jun 24 16:25:25.990792 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: INFO nova.api.openstack.requestlog [None req-83a21deb-1cb3-4821-add7-2872f3081f56 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.88 time: 0.016974 Jun 24 16:25:25.991283 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: [pid: 87434|app: 0|req: 21/42] 10.222.0.18 () {60 vars in 1190 bytes} [Fri Jun 24 16:25:25 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 18 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Jun 24 16:25:27.365289 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi [None req-647de4dc-6126-47c7-b37c-0bcee617296c admin admin] Calling method '>' {{(pid=87435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:25:27.366330 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: INFO nova.api.openstack.requestlog [None req-647de4dc-6126-47c7-b37c-0bcee617296c admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001427 Jun 24 16:25:27.366765 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: [pid: 87435|app: 0|req: 22/43] 10.222.0.18 () {56 vars in 1074 bytes} [Fri Jun 24 16:25:27 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 16:25:27.551952 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi [None req-92ef7662-f842-4043-9a49-8a97ddfe7ff3 admin admin] Calling method '>' {{(pid=87434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:25:27.564520 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: INFO nova.api.openstack.wsgi [None req-92ef7662-f842-4043-9a49-8a97ddfe7ff3 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jun 24 16:25:27.565076 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi [None req-92ef7662-f842-4043-9a49-8a97ddfe7ff3 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=87434) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jun 24 16:25:27.565854 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: INFO nova.api.openstack.requestlog [None req-92ef7662-f842-4043-9a49-8a97ddfe7ff3 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.88 time: 0.062562 Jun 24 16:25:27.566358 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: [pid: 87434|app: 0|req: 22/44] 10.222.0.18 () {60 vars in 1190 bytes} [Fri Jun 24 16:25:27 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 24 16:25:27.575867 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi [None req-51c994c7-278f-436c-a097-221f7a730740 admin admin] Calling method '>' {{(pid=87435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:25:27.596257 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: INFO nova.api.openstack.requestlog [None req-51c994c7-278f-436c-a097-221f7a730740 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.88 time: 0.023993 Jun 24 16:25:27.596770 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: [pid: 87435|app: 0|req: 23/45] 10.222.0.18 () {60 vars in 1210 bytes} [Fri Jun 24 16:25:27 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 16:25:27.605873 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi [None req-d986fcbd-504f-44db-92bf-047829bcce84 admin admin] Calling method '>' {{(pid=87434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:25:27.625799 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: INFO nova.api.openstack.requestlog [None req-d986fcbd-504f-44db-92bf-047829bcce84 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.88 time: 0.023309 Jun 24 16:25:27.626349 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: [pid: 87434|app: 0|req: 23/46] 10.222.0.18 () {60 vars in 1210 bytes} [Fri Jun 24 16:25:27 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 16:25:27.635427 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi [None req-f1ddd883-0c66-4e61-8f9d-922e7e8c1d31 admin admin] Calling method '>' {{(pid=87435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:25:27.647156 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: INFO nova.api.openstack.wsgi [None req-f1ddd883-0c66-4e61-8f9d-922e7e8c1d31 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jun 24 16:25:27.647709 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi [None req-f1ddd883-0c66-4e61-8f9d-922e7e8c1d31 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=87435) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jun 24 16:25:27.648548 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: INFO nova.api.openstack.requestlog [None req-f1ddd883-0c66-4e61-8f9d-922e7e8c1d31 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.88 time: 0.016629 Jun 24 16:25:27.649062 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: [pid: 87435|app: 0|req: 24/47] 10.222.0.18 () {60 vars in 1190 bytes} [Fri Jun 24 16:25:27 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 18 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 24 16:25:29.010819 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi [None req-d986fcbd-504f-44db-92bf-047829bcce84 admin admin] Calling method '>' {{(pid=87434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:25:29.011814 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: INFO nova.api.openstack.requestlog [None req-d986fcbd-504f-44db-92bf-047829bcce84 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001446 Jun 24 16:25:29.012210 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: [pid: 87434|app: 0|req: 24/48] 10.222.0.18 () {56 vars in 1074 bytes} [Fri Jun 24 16:25:29 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 16:25:29.197256 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi [None req-bd3b15e4-9efb-402d-a0ae-6488e05d0118 admin admin] Calling method '>' {{(pid=87435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:25:29.209099 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: INFO nova.api.openstack.wsgi [None req-bd3b15e4-9efb-402d-a0ae-6488e05d0118 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jun 24 16:25:29.209657 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi [None req-bd3b15e4-9efb-402d-a0ae-6488e05d0118 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=87435) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jun 24 16:25:29.210439 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: INFO nova.api.openstack.requestlog [None req-bd3b15e4-9efb-402d-a0ae-6488e05d0118 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.88 time: 0.063130 Jun 24 16:25:29.210973 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: [pid: 87435|app: 0|req: 25/49] 10.222.0.18 () {60 vars in 1193 bytes} [Fri Jun 24 16:25:29 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 24 16:25:29.221120 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi [None req-34534a85-5183-4100-8e23-e19cf0cb7fcc admin admin] Calling method '>' {{(pid=87434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:25:29.241844 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: INFO nova.api.openstack.requestlog [None req-34534a85-5183-4100-8e23-e19cf0cb7fcc admin admin] 10.222.0.18 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.88 time: 0.024273 Jun 24 16:25:29.242388 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: [pid: 87434|app: 0|req: 25/50] 10.222.0.18 () {60 vars in 1210 bytes} [Fri Jun 24 16:25:29 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 16:25:29.252817 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi [None req-3082d52f-4371-490d-84e3-588bd7144867 admin admin] Calling method '>' {{(pid=87435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:25:29.273016 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: INFO nova.api.openstack.requestlog [None req-3082d52f-4371-490d-84e3-588bd7144867 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.88 time: 0.024072 Jun 24 16:25:29.273620 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: [pid: 87435|app: 0|req: 26/51] 10.222.0.18 () {60 vars in 1210 bytes} [Fri Jun 24 16:25:29 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 16:25:29.283348 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi [None req-1c7d43ec-719a-45a3-b8cb-d7d6a54581d4 admin admin] Calling method '>' {{(pid=87434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:25:29.296034 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: INFO nova.api.openstack.wsgi [None req-1c7d43ec-719a-45a3-b8cb-d7d6a54581d4 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jun 24 16:25:29.296598 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi [None req-1c7d43ec-719a-45a3-b8cb-d7d6a54581d4 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=87434) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jun 24 16:25:29.297368 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: INFO nova.api.openstack.requestlog [None req-1c7d43ec-719a-45a3-b8cb-d7d6a54581d4 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.88 time: 0.017564 Jun 24 16:25:29.297871 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: [pid: 87434|app: 0|req: 26/52] 10.222.0.18 () {60 vars in 1193 bytes} [Fri Jun 24 16:25:29 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 18 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Jun 24 16:25:30.669140 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi [None req-3082d52f-4371-490d-84e3-588bd7144867 admin admin] Calling method '>' {{(pid=87435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:25:30.670123 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: INFO nova.api.openstack.requestlog [None req-3082d52f-4371-490d-84e3-588bd7144867 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001468 Jun 24 16:25:30.670520 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: [pid: 87435|app: 0|req: 27/53] 10.222.0.18 () {56 vars in 1074 bytes} [Fri Jun 24 16:25:30 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 16:25:30.861468 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi [None req-0ca5116d-fa57-4424-8955-14f14a35560b admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=87434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 16:25:30.884428 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: INFO nova.api.openstack.requestlog [None req-0ca5116d-fa57-4424-8955-14f14a35560b admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.88 time: 0.072071 Jun 24 16:25:30.884895 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: [pid: 87434|app: 0|req: 27/54] 10.222.0.18 () {64 vars in 1235 bytes} [Fri Jun 24 16:25:30 2022] POST /compute/v2.1/flavors => generated 404 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 16:25:32.243682 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi [None req-3082d52f-4371-490d-84e3-588bd7144867 admin admin] Calling method '>' {{(pid=87435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:25:32.244671 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: INFO nova.api.openstack.requestlog [None req-3082d52f-4371-490d-84e3-588bd7144867 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001435 Jun 24 16:25:32.245074 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: [pid: 87435|app: 0|req: 28/55] 10.222.0.18 () {56 vars in 1074 bytes} [Fri Jun 24 16:25:32 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 16:25:32.429490 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi [None req-8c11e743-78f3-413f-ac76-fc1b2e9fed05 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=87434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 16:25:32.455073 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: INFO nova.api.openstack.requestlog [None req-8c11e743-78f3-413f-ac76-fc1b2e9fed05 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.88 time: 0.073893 Jun 24 16:25:32.455545 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: [pid: 87434|app: 0|req: 28/56] 10.222.0.18 () {64 vars in 1235 bytes} [Fri Jun 24 16:25:32 2022] POST /compute/v2.1/flavors => generated 405 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 24 16:25:33.826150 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi [None req-3082d52f-4371-490d-84e3-588bd7144867 admin admin] Calling method '>' {{(pid=87435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:25:33.827158 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: INFO nova.api.openstack.requestlog [None req-3082d52f-4371-490d-84e3-588bd7144867 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002063 Jun 24 16:25:33.827553 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: [pid: 87435|app: 0|req: 29/57] 10.222.0.18 () {56 vars in 1074 bytes} [Fri Jun 24 16:25:33 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 16:25:34.011380 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi [None req-ad5889be-2f76-4af2-93db-f414e81bcdc0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=87434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 16:25:34.035205 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: INFO nova.api.openstack.requestlog [None req-ad5889be-2f76-4af2-93db-f414e81bcdc0 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.88 time: 0.073507 Jun 24 16:25:34.035748 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: [pid: 87434|app: 0|req: 29/58] 10.222.0.18 () {64 vars in 1235 bytes} [Fri Jun 24 16:25:33 2022] POST /compute/v2.1/flavors => generated 407 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 16:25:35.418868 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi [None req-3082d52f-4371-490d-84e3-588bd7144867 admin admin] Calling method '>' {{(pid=87435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:25:35.419892 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: INFO nova.api.openstack.requestlog [None req-3082d52f-4371-490d-84e3-588bd7144867 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001446 Jun 24 16:25:35.420288 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: [pid: 87435|app: 0|req: 30/59] 10.222.0.18 () {56 vars in 1074 bytes} [Fri Jun 24 16:25:35 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 16:25:35.604967 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi [None req-17a50d16-e86a-48f5-98e6-08d981a39923 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=87434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 16:25:35.628629 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: INFO nova.api.openstack.requestlog [None req-17a50d16-e86a-48f5-98e6-08d981a39923 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.88 time: 0.073041 Jun 24 16:25:35.629094 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: [pid: 87434|app: 0|req: 30/60] 10.222.0.18 () {64 vars in 1235 bytes} [Fri Jun 24 16:25:35 2022] POST /compute/v2.1/flavors => generated 409 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 16:25:36.995276 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi [None req-3082d52f-4371-490d-84e3-588bd7144867 admin admin] Calling method '>' {{(pid=87435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:25:36.996256 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: INFO nova.api.openstack.requestlog [None req-3082d52f-4371-490d-84e3-588bd7144867 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001418 Jun 24 16:25:36.996645 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: [pid: 87435|app: 0|req: 31/61] 10.222.0.18 () {56 vars in 1074 bytes} [Fri Jun 24 16:25:36 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 16:25:37.189317 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi [None req-e1056c98-37d8-44ab-ac1f-0adf34338c07 admin admin] Calling method '>' {{(pid=87434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:25:37.214646 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: INFO nova.api.openstack.requestlog [None req-e1056c98-37d8-44ab-ac1f-0adf34338c07 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.88 time: 0.073903 Jun 24 16:25:37.215138 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: [pid: 87434|app: 0|req: 31/62] 10.222.0.18 () {60 vars in 1202 bytes} [Fri Jun 24 16:25:37 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 16:26:17.241742 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi [None req-3082d52f-4371-490d-84e3-588bd7144867 admin admin] Calling method '>' {{(pid=87435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:26:17.242750 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: INFO nova.api.openstack.requestlog [None req-3082d52f-4371-490d-84e3-588bd7144867 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001397 Jun 24 16:26:17.243155 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: [pid: 87435|app: 0|req: 32/63] 10.222.0.18 () {56 vars in 1074 bytes} [Fri Jun 24 16:26:17 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 16:26:17.433522 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi [None req-4d762718-0306-4a05-bd4c-39f19a1823ac admin admin] Calling method '>' {{(pid=87434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:26:17.458793 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: INFO nova.api.openstack.requestlog [None req-4d762718-0306-4a05-bd4c-39f19a1823ac admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.88 time: 0.074835 Jun 24 16:26:17.459274 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: [pid: 87434|app: 0|req: 32/64] 10.222.0.18 () {60 vars in 1202 bytes} [Fri Jun 24 16:26:17 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 16:29:03.646731 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi [None req-3082d52f-4371-490d-84e3-588bd7144867 admin admin] Calling method '>' {{(pid=87435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:29:03.647723 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: INFO nova.api.openstack.requestlog [None req-3082d52f-4371-490d-84e3-588bd7144867 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001418 Jun 24 16:29:03.648120 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: [pid: 87435|app: 0|req: 33/65] 10.222.0.18 () {56 vars in 1074 bytes} [Fri Jun 24 16:29:03 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 16:29:03.901840 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi [None req-7bab9f86-1307-47a4-9135-714950bfdbd0 admin admin] Calling method '>' {{(pid=87434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:29:03.903427 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 24 16:29:03.903427 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: warnings.warn(msg) Jun 24 16:29:03.904944 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG oslo_concurrency.lockutils [None req-7bab9f86-1307-47a4-9135-714950bfdbd0 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:29:03.905412 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG oslo_concurrency.lockutils [None req-7bab9f86-1307-47a4-9135-714950bfdbd0 admin admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:29:03.906186 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG oslo_concurrency.lockutils [None req-7bab9f86-1307-47a4-9135-714950bfdbd0 admin admin] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:29:03.906759 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG oslo_concurrency.lockutils [None req-7bab9f86-1307-47a4-9135-714950bfdbd0 admin admin] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:29:03.937421 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: INFO nova.api.openstack.requestlog [None req-7bab9f86-1307-47a4-9135-714950bfdbd0 admin admin] 10.222.0.18 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.88 time: 0.152696 Jun 24 16:29:03.938175 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: [pid: 87434|app: 0|req: 33/66] 10.222.0.18 () {60 vars in 1193 bytes} [Fri Jun 24 16:29:03 2022] GET /compute/v2.1/os-services => generated 791 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 16:29:05.326753 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi [None req-3082d52f-4371-490d-84e3-588bd7144867 admin admin] Calling method '>' {{(pid=87435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:29:05.327849 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: INFO nova.api.openstack.requestlog [None req-3082d52f-4371-490d-84e3-588bd7144867 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001585 Jun 24 16:29:05.328316 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: [pid: 87435|app: 0|req: 34/67] 10.222.0.18 () {56 vars in 1074 bytes} [Fri Jun 24 16:29:05 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 16:29:05.512771 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi [None req-85575850-cda7-4ef4-ba24-bb52b3b1fa74 admin admin] Calling method '>' {{(pid=87434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:29:05.513933 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 24 16:29:05.513933 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: warnings.warn(msg) Jun 24 16:29:05.515455 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG oslo_concurrency.lockutils [None req-85575850-cda7-4ef4-ba24-bb52b3b1fa74 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:29:05.515902 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG oslo_concurrency.lockutils [None req-85575850-cda7-4ef4-ba24-bb52b3b1fa74 admin admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:29:05.516686 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG oslo_concurrency.lockutils [None req-85575850-cda7-4ef4-ba24-bb52b3b1fa74 admin admin] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:29:05.517115 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG oslo_concurrency.lockutils [None req-85575850-cda7-4ef4-ba24-bb52b3b1fa74 admin admin] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:29:05.539444 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: INFO nova.api.openstack.requestlog [None req-85575850-cda7-4ef4-ba24-bb52b3b1fa74 admin admin] 10.222.0.18 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.88 time: 0.076479 Jun 24 16:29:05.539992 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: [pid: 87434|app: 0|req: 34/68] 10.222.0.18 () {60 vars in 1193 bytes} [Fri Jun 24 16:29:05 2022] GET /compute/v2.1/os-services => generated 791 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 16:29:17.355057 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi [None req-3082d52f-4371-490d-84e3-588bd7144867 admin admin] Calling method '>' {{(pid=87435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:29:17.356076 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: INFO nova.api.openstack.requestlog [None req-3082d52f-4371-490d-84e3-588bd7144867 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001490 Jun 24 16:29:17.356474 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: [pid: 87435|app: 0|req: 35/69] 10.222.0.18 () {56 vars in 1074 bytes} [Fri Jun 24 16:29:17 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 16:29:17.545192 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi [None req-00342058-b93a-40a9-8023-56ca4fca0fe9 admin admin] Calling method '>' {{(pid=87434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:29:17.546471 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 24 16:29:17.546471 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: warnings.warn(msg) Jun 24 16:29:17.548024 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG oslo_concurrency.lockutils [None req-00342058-b93a-40a9-8023-56ca4fca0fe9 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:29:17.548469 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG oslo_concurrency.lockutils [None req-00342058-b93a-40a9-8023-56ca4fca0fe9 admin admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:29:17.549311 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG oslo_concurrency.lockutils [None req-00342058-b93a-40a9-8023-56ca4fca0fe9 admin admin] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:29:17.549773 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG oslo_concurrency.lockutils [None req-00342058-b93a-40a9-8023-56ca4fca0fe9 admin admin] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:29:17.578972 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: INFO nova.api.openstack.requestlog [None req-00342058-b93a-40a9-8023-56ca4fca0fe9 admin admin] 10.222.0.18 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.88 time: 0.082917 Jun 24 16:29:17.579469 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: [pid: 87434|app: 0|req: 35/70] 10.222.0.18 () {60 vars in 1193 bytes} [Fri Jun 24 16:29:17 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 16:29:18.981987 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: DEBUG nova.api.openstack.wsgi [None req-3082d52f-4371-490d-84e3-588bd7144867 admin admin] Calling method '>' {{(pid=87435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:29:18.983030 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: INFO nova.api.openstack.requestlog [None req-3082d52f-4371-490d-84e3-588bd7144867 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001452 Jun 24 16:29:18.983431 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: [pid: 87435|app: 0|req: 36/71] 10.222.0.18 () {56 vars in 1074 bytes} [Fri Jun 24 16:29:18 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 16:29:19.169467 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG nova.api.openstack.wsgi [None req-dd263ff8-e680-4b21-90ac-33c9a8868cf7 admin admin] Calling method '>' {{(pid=87434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:29:19.170619 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 24 16:29:19.170619 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: warnings.warn(msg) Jun 24 16:29:19.172320 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG oslo_concurrency.lockutils [None req-dd263ff8-e680-4b21-90ac-33c9a8868cf7 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:29:19.172763 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG oslo_concurrency.lockutils [None req-dd263ff8-e680-4b21-90ac-33c9a8868cf7 admin admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:29:19.173588 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG oslo_concurrency.lockutils [None req-dd263ff8-e680-4b21-90ac-33c9a8868cf7 admin admin] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:29:19.174004 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: DEBUG oslo_concurrency.lockutils [None req-dd263ff8-e680-4b21-90ac-33c9a8868cf7 admin admin] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:29:19.199306 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: INFO nova.api.openstack.requestlog [None req-dd263ff8-e680-4b21-90ac-33c9a8868cf7 admin admin] 10.222.0.18 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.88 time: 0.080250 Jun 24 16:29:19.199867 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: [pid: 87434|app: 0|req: 36/72] 10.222.0.18 () {60 vars in 1193 bytes} [Fri Jun 24 16:29:19 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 16:30:17.359654 dv-cinder-847189-3-iscsi devstack@n-api.service[87433]: Fri Jun 24 16:30:17 2022 - graceful shutdown triggered... Jun 24 16:30:17.359766 dv-cinder-847189-3-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Jun 24 16:30:17.360728 dv-cinder-847189-3-iscsi devstack@n-api.service[87434]: Gracefully killing worker 1 (pid: 87434)... Jun 24 16:30:17.361164 dv-cinder-847189-3-iscsi devstack@n-api.service[87435]: Gracefully killing worker 2 (pid: 87435)... Jun 24 16:30:18.361236 dv-cinder-847189-3-iscsi devstack@n-api.service[87433]: worker 1 buried after 1 seconds Jun 24 16:30:18.361236 dv-cinder-847189-3-iscsi devstack@n-api.service[87433]: worker 2 buried after 1 seconds Jun 24 16:30:18.361236 dv-cinder-847189-3-iscsi devstack@n-api.service[87433]: goodbye to uWSGI. Jun 24 16:30:18.362765 dv-cinder-847189-3-iscsi systemd[1]: devstack@n-api.service: Succeeded. Jun 24 16:30:18.363307 dv-cinder-847189-3-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Jun 24 16:30:18.366092 dv-cinder-847189-3-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jun 24 16:30:18.379985 dv-cinder-847189-3-iscsi devstack@n-api.service[102130]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jun 24 16:30:18.381948 dv-cinder-847189-3-iscsi devstack@n-api.service[102130]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Jun 24 16:30:18 2022] *** Jun 24 16:30:18.381948 dv-cinder-847189-3-iscsi devstack@n-api.service[102130]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 24 16:30:18.381948 dv-cinder-847189-3-iscsi devstack@n-api.service[102130]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 24 16:30:18.381948 dv-cinder-847189-3-iscsi devstack@n-api.service[102130]: nodename: dv-cinder-847189-3-iscsi Jun 24 16:30:18.381948 dv-cinder-847189-3-iscsi devstack@n-api.service[102130]: machine: x86_64 Jun 24 16:30:18.381948 dv-cinder-847189-3-iscsi devstack@n-api.service[102130]: clock source: unix Jun 24 16:30:18.381948 dv-cinder-847189-3-iscsi devstack@n-api.service[102130]: pcre jit disabled Jun 24 16:30:18.381948 dv-cinder-847189-3-iscsi devstack@n-api.service[102130]: detected number of CPU cores: 4 Jun 24 16:30:18.381948 dv-cinder-847189-3-iscsi devstack@n-api.service[102130]: current working directory: / Jun 24 16:30:18.381948 dv-cinder-847189-3-iscsi devstack@n-api.service[102130]: detected binary path: /usr/bin/uwsgi-core Jun 24 16:30:18.382711 dv-cinder-847189-3-iscsi devstack@n-api.service[102130]: your processes number limit is 47680 Jun 24 16:30:18.382711 dv-cinder-847189-3-iscsi devstack@n-api.service[102130]: your memory page size is 4096 bytes Jun 24 16:30:18.382711 dv-cinder-847189-3-iscsi devstack@n-api.service[102130]: detected max file descriptor number: 2048 Jun 24 16:30:18.382711 dv-cinder-847189-3-iscsi devstack@n-api.service[102130]: lock engine: pthread robust mutexes Jun 24 16:30:18.382711 dv-cinder-847189-3-iscsi devstack@n-api.service[102130]: thunder lock: enabled Jun 24 16:30:18.382711 dv-cinder-847189-3-iscsi devstack@n-api.service[102130]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jun 24 16:30:18.382711 dv-cinder-847189-3-iscsi devstack@n-api.service[102130]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 24 16:30:18.429980 dv-cinder-847189-3-iscsi devstack@n-api.service[102130]: Python main interpreter initialized at 0x55a9603169c0 Jun 24 16:30:18.429980 dv-cinder-847189-3-iscsi devstack@n-api.service[102130]: python threads support enabled Jun 24 16:30:18.429980 dv-cinder-847189-3-iscsi devstack@n-api.service[102130]: your server socket listen backlog is limited to 100 connections Jun 24 16:30:18.429980 dv-cinder-847189-3-iscsi devstack@n-api.service[102130]: your mercy for graceful operations on workers is 90 seconds Jun 24 16:30:18.430422 dv-cinder-847189-3-iscsi devstack@n-api.service[102130]: mapped 403077 bytes (393 KB) for 2 cores Jun 24 16:30:18.430422 dv-cinder-847189-3-iscsi devstack@n-api.service[102130]: *** Operational MODE: preforking *** Jun 24 16:30:18.431248 dv-cinder-847189-3-iscsi devstack@n-api.service[102130]: *** uWSGI is running in multiple interpreter mode *** Jun 24 16:30:18.431248 dv-cinder-847189-3-iscsi devstack@n-api.service[102130]: spawned uWSGI master process (pid: 102130) Jun 24 16:30:18.431447 dv-cinder-847189-3-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jun 24 16:30:18.432061 dv-cinder-847189-3-iscsi devstack@n-api.service[102130]: spawned uWSGI worker 1 (pid: 102148, cores: 1) Jun 24 16:30:18.432431 dv-cinder-847189-3-iscsi devstack@n-api.service[102130]: spawned uWSGI worker 2 (pid: 102149, cores: 1) Jun 24 16:30:18.432588 dv-cinder-847189-3-iscsi devstack@n-api.service[102130]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 24 16:30:22.546125 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 24 16:30:22.546871 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 24 16:30:22.546871 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 24 16:30:22.547233 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 24 16:30:22.548181 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 24 16:30:22.548181 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:30:22.548181 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:30:22.548492 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:30:22.548833 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:30:22.549152 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:30:22.549471 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:30:22.549796 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:30:22.550121 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:30:22.550453 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:30:22.550784 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:30:22.551055 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:30:22.551385 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-847189-3-iscsi {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:30:22.551721 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:30:22.552031 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:30:22.552348 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:30:22.552672 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:30:22.552982 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:30:22.553308 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:30:22.553617 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:30:22.554135 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:30:22.555395 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:30:22.555395 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:30:22.555395 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:30:22.555649 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:30:22.555906 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:30:22.556313 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:30:22.556697 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:30:22.557017 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:30:22.557345 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:30:22.557656 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:30:22.557982 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-847189-3-iscsi {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:30:22.558303 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:30:22.558624 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:30:22.558987 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:30:22.559396 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:30:22.559735 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:30:22.560037 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:30:22.560476 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:30:22.560723 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:30:22.560986 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:30:22.561333 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:30:22.561635 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:30:22.561957 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:30:22.562516 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:30:22.566470 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:30:22.566470 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:30:22.566470 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:30:22.566470 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:30:22.566470 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:30:22.566470 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:30:22.566470 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:30:22.566470 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:30:22.567183 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:30:22.567183 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:30:22.567183 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:30:22.567183 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:30:22.567183 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:30:22.567183 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:30:22.567644 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:30:22.567644 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:30:22.567644 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:30:22.567884 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:30:22.568026 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:30:22.568338 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:30:22.568651 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:30:22.568961 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:30:22.569270 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:30:22.569593 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:30:22.569913 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:30:22.570240 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:30:22.570553 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:30:22.570903 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:30:22.571856 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.18 {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:30:22.572110 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.18 {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:30:22.572426 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:30:22.572772 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:30:22.573098 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:30:22.573412 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:30:22.573735 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:30:22.574060 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:30:22.574378 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:30:22.574703 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:30:22.575025 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:30:22.575523 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:30:22.575764 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:30:22.576073 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:30:22.576330 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:30:22.576632 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:30:22.576941 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:30:22.577264 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:30:22.577573 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:30:22.577884 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:30:22.578192 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:30:22.578500 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:30:22.578859 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:30:22.579175 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:30:22.579487 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:30:22.579797 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:30:22.580107 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:30:22.580415 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:30:22.580725 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:30:22.581035 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:30:22.581345 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:30:22.581665 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:30:22.581991 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:30:22.582298 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:30:22.582605 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:30:22.582937 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:30:22.583245 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:30:22.583571 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:30:22.583879 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:30:22.584188 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:30:22.584521 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:30:22.584834 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:30:22.585141 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:30:22.585460 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:30:22.586028 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:30:22.586337 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:30:22.587311 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:30:22.587533 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:30:22.587842 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:30:22.588164 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:30:22.588533 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:30:22.588785 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:30:22.589097 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:30:22.589415 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:30:22.589711 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:30:22.590019 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:30:22.590327 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:30:22.590635 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:30:22.590966 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:30:22.591290 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:30:22.591612 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:30:22.592018 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:30:22.592292 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:30:22.592539 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:30:22.592863 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:30:22.593208 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.593542 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.593813 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 24 16:30:22.594258 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.594336 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 24 16:30:22.594417 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.594616 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.594749 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 24 16:30:22.594907 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.595039 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 24 16:30:22.595193 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 24 16:30:22.595294 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.595517 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.595684 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:30:22.596010 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.596129 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:30:22.596348 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.596481 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:30:22.596670 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.596919 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:30:22.597029 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.597124 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:30:22.597294 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.597436 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:30:22.597616 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.597811 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:30:22.598066 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.598168 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:30:22.598269 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.598493 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:30:22.598611 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.598885 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:30:22.598995 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.599187 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:30:22.599301 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.599650 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.599767 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-847189-3-iscsi {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:30:22.599869 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.599962 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:30:22.600152 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.600258 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:30:22.600465 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.600569 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:30:22.600783 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.600890 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:30:22.601127 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.601274 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:30:22.601472 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.601629 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:30:22.601775 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:30:22.601912 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.602108 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.602300 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:30:22.602468 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.602625 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:30:22.602857 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.602995 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:30:22.603144 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.603283 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:30:22.603431 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.603578 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:30:22.603725 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.603868 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:30:22.604013 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.604157 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:30:22.604308 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.604446 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:30:22.604634 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.604761 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:30:22.604953 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.605102 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:30:22.605274 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.605400 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:30:22.605618 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.605730 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-847189-3-iscsi {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:30:22.605931 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.606020 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:30:22.613988 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.614122 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:30:22.614227 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.614324 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:30:22.614409 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.614492 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:30:22.614590 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.614684 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:30:22.614791 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.614876 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:30:22.614972 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.615068 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:30:22.615161 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.615245 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:30:22.615347 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.615440 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:30:22.615538 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.615624 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:30:22.615706 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.615789 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:30:22.615878 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.615980 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:30:22.616077 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.616163 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:30:22.616252 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.616342 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:30:22.616426 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.616508 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:30:22.616604 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.616691 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:30:22.616780 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.616871 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:30:22.616962 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.617047 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:30:22.617142 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.617227 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:30:22.617308 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.617390 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:30:22.617480 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.617573 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:30:22.617657 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.617739 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:30:22.617820 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.617934 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:30:22.618021 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.618113 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:30:22.618113 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:30:22.618285 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.618377 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:30:22.618468 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.618565 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:30:22.618656 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.618771 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:30:22.618844 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.618926 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:30:22.619022 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.619116 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:30:22.619210 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.619293 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:30:22.619374 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.619462 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:30:22.619552 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.619651 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:30:22.619742 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.619833 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:30:22.619916 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.620004 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:30:22.620086 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.620187 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:30:22.620272 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.620361 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:30:22.620491 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.620591 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:30:22.620691 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.620782 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:30:22.620877 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.620967 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:30:22.621058 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.621181 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:30:22.621458 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.621548 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.18 {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:30:22.621620 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.621697 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.18 {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:30:22.621774 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.621845 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:30:22.621993 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.622105 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:30:22.622192 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.622283 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:30:22.622368 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.622445 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:30:22.622526 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.622605 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:30:22.622684 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.622788 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:30:22.622869 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.622949 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:30:22.623029 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.623108 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:30:22.623184 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.623261 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:30:22.623339 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.623339 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.623339 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.623339 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.623602 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:30:22.623680 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.623751 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:30:22.623819 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.623900 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:30:22.623971 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.624039 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:30:22.624107 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.624175 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:30:22.624242 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.624384 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:30:22.624464 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.624542 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:30:22.624613 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.624743 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:30:22.624916 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.625052 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:30:22.625254 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.625385 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:30:22.625666 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:30:22.625975 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:30:22.626153 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.626468 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:30:22.626576 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.626661 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:30:22.626911 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.627012 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:30:22.627190 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.627293 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:30:22.627485 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:30:22.627600 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = None {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.627799 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = None {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.627931 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:30:22.628148 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.628277 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:30:22.628454 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.628559 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:30:22.628768 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.628871 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:30:22.629091 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.629191 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:30:22.629404 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.629497 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:30:22.629722 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.629820 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:30:22.630029 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:30:22.630120 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_vgpu_types = [] {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.630337 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:30:22.630427 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.630659 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:30:22.630789 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.631001 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:30:22.631093 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.631308 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:30:22.631414 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.631633 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:30:22.631752 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.631940 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:30:22.632043 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.632247 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:30:22.632341 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.632557 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.632648 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:30:22.632860 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:30:22.632965 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.633167 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:30:22.633260 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.633483 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.634104 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:30:22.634317 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:30:22.634417 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.634625 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:30:22.634793 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.634968 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:30:22.635068 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.635275 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:30:22.635380 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.635582 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:30:22.635674 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.635889 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.635982 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:30:22.636193 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:30:22.636292 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.636505 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:30:22.636628 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.636812 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:30:22.636925 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.637118 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:30:22.637227 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.637444 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.637554 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:30:22.637760 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:30:22.637890 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.638068 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.638195 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:30:22.638377 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.638477 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:30:22.638702 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:30:22.638814 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.639015 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:30:22.639114 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.639323 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.639422 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:30:22.639632 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.639723 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 16:30:22.639940 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.640040 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.640287 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.640387 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.640603 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.640703 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.640913 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.641011 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.641239 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.641416 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.641567 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.641804 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.641945 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.642088 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.642236 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.642373 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.642529 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.642679 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.642807 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.642903 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.643099 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.643192 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.643414 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.643520 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.643726 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.643819 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.644039 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.644130 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.644353 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.644453 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.644668 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.644759 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.644981 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.645072 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.645297 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.645404 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.645610 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.645701 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.645925 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.646016 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.646260 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.646373 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.646549 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.646653 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.646957 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.647071 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.647284 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.647503 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.647617 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.647866 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.647960 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.648205 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.648305 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.648527 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.648634 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.648850 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.648968 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.649218 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.649812 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.650037 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.650136 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.650350 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.650448 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.650776 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.650916 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.651058 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.651242 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.651377 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.651560 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.651690 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.651883 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.652037 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.652188 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.652340 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.652486 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.652626 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.652902 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.653182 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.653287 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.653507 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.654287 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.654396 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.654485 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.654558 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.654627 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.654739 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.654830 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.654910 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.654980 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.655049 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.655212 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.655341 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.655531 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.655652 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.655848 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.656053 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.656154 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.656346 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.656447 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.656606 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.656749 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.656920 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.657057 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.657229 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.657363 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.657538 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.657672 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.657846 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.657979 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.658192 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.658301 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.658535 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.658627 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.659133 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.659229 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.659331 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.659411 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.659539 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.659621 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.660035 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.660150 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.660340 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.660443 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.660678 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.660779 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.660991 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.661103 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.661298 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.661392 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.661649 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.661761 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.662004 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.662180 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.662317 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.662408 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.662618 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.662826 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.662925 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.663069 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.663172 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.663380 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.663485 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.663690 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.663790 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.664009 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.664101 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.664325 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.664446 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.664638 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.664738 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.664971 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.665088 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.665280 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.665518 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.665604 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.665840 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.665933 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.666223 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.666426 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.666586 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.666674 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.666868 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.667134 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.667222 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.667351 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.667444 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.667685 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.667778 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.668013 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.668104 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.668334 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.668426 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.668667 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.668837 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.668977 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.669131 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.669281 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.669466 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.669661 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.669798 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.670147 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.670293 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.670442 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.670584 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.670747 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.670840 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.670971 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.671098 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.671200 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.671404 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.671498 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.671718 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.671906 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.672169 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.672337 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.672486 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.672620 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.672718 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.672943 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.673044 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.673254 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.673402 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.673544 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.673692 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.673991 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.674146 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.674295 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.674445 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.674586 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.674779 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.674887 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.675125 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.675226 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.675444 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.675614 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.675773 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.675878 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.676086 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.676184 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.676403 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.676509 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.676715 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = None {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.676819 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.677020 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.677118 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = None {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.677331 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.677433 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.677643 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.677734 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.677952 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.678040 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.678259 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.678347 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.678566 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.678656 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.678908 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.679020 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.679217 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.679315 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_vgpu_types = [] {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.679534 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.679635 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.679860 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.680146 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.680290 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.680468 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.680617 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.680756 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.680895 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.681035 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.681175 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.681322 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.681486 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.681626 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.681763 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.681918 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.682066 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.682222 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.682371 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.682534 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.682670 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.682865 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.683015 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.683163 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.683309 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.683465 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.683559 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.683643 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.683842 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.683945 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.684151 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.684242 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.684468 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.684568 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.684785 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.684888 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.685094 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.685194 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.685423 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.685516 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.685733 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.685832 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.686042 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.686133 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.686359 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.686531 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.686707 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.686800 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.686990 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.687089 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.687298 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.687389 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.687611 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.687739 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.687918 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.688056 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.688225 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.688372 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.688530 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.688685 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.688874 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.688989 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.689190 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.689303 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.689494 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.689608 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.689812 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.690002 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.690129 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.690304 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.690435 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.690667 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.690792 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.691004 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.691104 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.691322 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.691418 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.691639 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.691741 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.691947 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.692060 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.692307 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.692411 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.692565 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.692675 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.692897 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.693017 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.693203 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.693300 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.693510 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.693601 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.693820 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.693921 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.694129 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.694218 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.694439 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.694531 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.694774 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.694884 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.695083 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.695182 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.695394 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.695485 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.695714 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.695818 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.696744 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.697346 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.697453 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.697453 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.697603 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.697683 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.697753 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.698013 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.698103 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.698339 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.698431 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.698650 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.698840 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.698993 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.699087 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.699314 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.699421 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.699642 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.699738 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.699949 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.700053 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.700311 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.700432 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.700582 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.700674 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.700872 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.700974 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.701328 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.701638 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.701947 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.702259 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.702383 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.702573 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.702711 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.702907 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.703024 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.703213 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.703304 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.703518 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.703723 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.703816 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.704064 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.704153 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.704391 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.704490 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.704722 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.704812 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.705029 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.705127 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.705354 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.705462 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.705667 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.705757 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.705970 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.706058 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.706274 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.706379 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.706586 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.706730 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.706942 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.707257 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.707579 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.707860 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.707970 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.708199 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.708298 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.708513 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.708608 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.708823 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.708953 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.709154 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.709316 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.709465 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.709634 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.709802 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.709949 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.710123 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.710283 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.710458 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.710957 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.711124 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.711229 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.711440 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.711602 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.712339 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.712436 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.712632 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.712809 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.712961 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.713072 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.713263 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.713401 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.713548 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.713687 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.713839 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.713983 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.714123 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.714260 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.714405 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.714562 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.714755 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.714908 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.715058 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.715204 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.715351 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.715490 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.715713 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.715855 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.716032 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.716177 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.716352 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.716513 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.716653 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.716806 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.716977 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.717093 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.717287 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.717390 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.717594 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.717694 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.717907 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.718000 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.718215 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.718321 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.718521 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.718619 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.718858 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.718950 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.719174 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.719275 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.719483 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.719571 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.719787 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.719883 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.720101 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.720193 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.720456 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.720573 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.720765 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.720864 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.721077 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.721239 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.721389 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.721491 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.721698 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.721790 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.722002 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.722103 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.722306 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.722397 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.722613 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.722790 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.722946 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.723089 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.723279 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.723380 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.723619 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.723747 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.723898 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.723999 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.724205 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.724298 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.724509 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.724611 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.724855 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.724947 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.725164 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.725254 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.725481 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.725582 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.725801 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.725902 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.726121 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.726213 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.726440 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.726546 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.726781 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.726881 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.727096 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.727196 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.727434 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.727529 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.727744 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.727855 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.728059 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.728154 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.728371 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.728465 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.728685 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.728964 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.729086 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.729270 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.729379 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.729599 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.729772 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.729931 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.730126 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.730903 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.731074 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.731247 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.731483 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.731637 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.731775 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.731932 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.731932 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = False {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.731932 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.732330 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.732469 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.732739 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.733075 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.734039 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.734194 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.734194 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.734478 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.734619 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.734800 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.734894 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.735033 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.735115 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.735187 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.735269 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.735343 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.735420 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.735497 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.735644 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.735760 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.735968 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.736091 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.736293 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.736426 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.736614 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.736752 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.736934 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.737160 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.737254 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.737402 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.737554 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.737724 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.737877 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.738047 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.738199 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.738365 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.738514 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.738819 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.738921 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.739080 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.739162 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.739397 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.739497 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.739717 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.739879 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.740030 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.740125 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.740349 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.740443 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.740661 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.740754 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.741039 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.741119 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.741404 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.741687 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.742181 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.742332 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.742482 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.742620 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.742790 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.742969 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.743172 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.743327 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.743463 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.743614 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.743760 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.743897 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.744032 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.744168 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.744315 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.744470 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.744617 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.744753 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.744889 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.745024 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.745159 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.745315 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.745534 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.745672 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.745808 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.745943 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.746088 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.746245 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.746394 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.746540 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.746700 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.746839 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.747049 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.747264 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.747526 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.747526 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.747806 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.747886 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.747966 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.748045 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.748160 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.748466 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.748549 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.748784 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.748875 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.749194 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.749294 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.749482 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.749596 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.749757 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.749846 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.750071 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.750152 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.750380 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.750478 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.750890 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.750999 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.751074 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.751156 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.751332 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.751413 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.751641 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.751740 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.752071 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.752222 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.752379 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.752528 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.752679 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.752816 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.752952 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.753101 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.753326 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.753487 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.753582 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.753717 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.753797 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.754067 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.754155 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.754378 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.754466 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.754711 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.754796 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.755021 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.755113 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.755329 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.755501 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.755639 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.755829 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.756144 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.756233 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.756477 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.756566 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.756789 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.756869 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.757097 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.757241 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.757404 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.757588 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.757718 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.757874 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.758023 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.758189 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.758331 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.759041 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.759361 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.759436 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.759505 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.759699 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.759820 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.760012 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.760132 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.760329 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.760446 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.760653 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.760756 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.761040 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.761134 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.761298 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.761395 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.761614 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.761695 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.762223 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.762328 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.762408 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.762533 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.762678 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.762829 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.763014 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.763141 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.763398 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.763537 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.763655 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.763929 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.764085 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.764171 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.764252 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.764458 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.764540 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.764771 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.764858 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.765083 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.765177 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.765395 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.765475 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.765726 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.765807 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.766043 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.766137 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.766360 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.766448 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.766676 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.766948 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.767037 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_native_luksv1 = False {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.767122 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.767395 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.767523 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.767753 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.767845 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.768073 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.768168 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.768392 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.768473 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.768707 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.768786 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.769023 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.769103 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.769337 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.769424 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.769646 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.769725 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.rbd_volume_local_attach = False {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.769949 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.770029 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.770253 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.770339 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.770565 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.770662 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.771234 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.771331 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.771404 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.771473 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.771549 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.771633 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.771786 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.771875 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.772498 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.772672 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.772817 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.772970 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.773114 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.773262 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.773412 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.773639 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.773799 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.773956 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.774107 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.774935 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.775084 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.775238 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.775382 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.775534 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.775686 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.775829 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.775978 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.776121 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.776284 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.776433 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.776586 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.776737 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.776960 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.777141 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.777295 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.777447 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.777597 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.777748 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.777981 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.777981 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.778408 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.778593 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.778768 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.778768 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.779048 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.779199 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.779342 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.779492 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.779635 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.779783 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.779935 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.780088 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.780230 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.780379 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.780532 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.780681 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.780840 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.781001 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.781145 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.781460 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.781610 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.781761 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.781912 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.782072 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.782305 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.782453 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.782634 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.782929 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.783095 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.783246 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.783390 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.783532 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.783754 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.783905 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.784063 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = False {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.784214 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.784366 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.784517 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.784659 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.784820 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.784974 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.785118 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.785267 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.785418 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.785418 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.785933 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.786088 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.786232 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.786377 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] database.use_db_reconnect = False {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.786519 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.786661 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] database.use_tpool = False {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.786850 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.786995 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.787136 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.787279 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.787422 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.787564 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.787855 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.788051 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.788269 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.788269 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.788549 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.788708 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.788900 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.789057 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.789201 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.789345 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.789488 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.789675 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.789847 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.789993 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.790135 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.790278 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.790429 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.790728 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.790904 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.791063 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.791206 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.791364 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.791668 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.792020 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.792181 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.792341 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.792556 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.792741 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.792920 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.793149 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.793297 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.793461 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.793606 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.793768 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.793995 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.794150 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.794302 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.794455 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.794599 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.794599 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.795109 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.795262 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.795412 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.795556 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.795728 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.795882 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.796033 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.796185 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.796337 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.796480 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.796632 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.796790 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.796934 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.797084 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.797336 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.797487 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.797642 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.797865 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.798019 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.798163 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.798400 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.798549 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.798728 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.798880 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.799042 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.799185 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.799335 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.799335 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.799621 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.799779 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.799922 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.800073 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.800216 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.800358 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.800518 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.800518 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=102149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 24 16:30:22.800798 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.800798 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.800798 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.800798 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.800798 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.800798 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.801812 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.801812 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.801812 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.802231 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.802231 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.802501 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.802782 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.803106 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.803423 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.803737 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.804046 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.804356 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.804663 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.804992 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.805302 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.805650 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.805959 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.806272 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.806577 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.806915 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.807223 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.807758 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.808072 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.808442 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.808690 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.808999 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.809445 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.810124 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.810124 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.810429 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.810626 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.810962 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.811268 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.811587 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.811917 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.812222 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.812535 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.812849 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.813195 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.813541 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.814139 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.814408 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.814805 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.815101 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.815442 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.816494 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.816494 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.816494 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.817135 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.817454 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.817841 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.818071 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.818418 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_native_luksv1 = False {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.818742 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.819042 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.819344 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.819662 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.819995 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.820284 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.820592 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.820905 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.rbd_volume_local_attach = False {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.821762 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.822212 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.822413 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.823067 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.823067 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.823402 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.823711 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.825987 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.825987 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.825987 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.825987 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.825987 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.825987 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.825987 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.831011 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.831011 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.831011 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.831011 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.831011 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.831011 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.831011 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.831011 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.832215 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.832215 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.832215 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.832215 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.832215 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.832215 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.832215 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.832215 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.833350 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.833350 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.833350 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.833350 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.833350 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.833350 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.833350 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.834330 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.834330 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.834330 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.834813 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.834813 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.835089 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.835336 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.836043 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.836394 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.839582 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.839582 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] database.use_db_reconnect = False {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.839582 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] database.use_tpool = False {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.839582 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.839582 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.839582 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.839582 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.839582 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.840755 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.840755 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.840755 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.840755 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.841687 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_db.sqlalchemy.engines [None req-43f9236f-f79e-46aa-bc3b-7b3ae0be7d79 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102149) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Jun 24 16:30:22.841842 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.841842 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.841842 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.841842 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.842553 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.842553 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.843063 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.843063 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.843345 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.843599 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.843908 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.844237 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.844557 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.844977 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.845310 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.845511 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.845841 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.846162 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.846462 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.846800 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.847115 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.847434 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.847754 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.848083 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.848413 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.848738 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.849191 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.849431 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.849711 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.850061 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.850389 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 16:30:22.850635 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=102148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 24 16:30:22.894817 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_db.sqlalchemy.engines [None req-fa65504a-2619-4dda-87c2-d0beb83a73ed None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102148) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Jun 24 16:30:23.091472 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.context [None req-43f9236f-f79e-46aa-bc3b-7b3ae0be7d79 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),c009b6fd-523d-40a4-8f6f-3f0e03d98acc(cell1) {{(pid=102149) load_cells /opt/stack/nova/nova/context.py:464}} Jun 24 16:30:23.095721 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-43f9236f-f79e-46aa-bc3b-7b3ae0be7d79 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:30:23.097375 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-43f9236f-f79e-46aa-bc3b-7b3ae0be7d79 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:30:23.098183 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-43f9236f-f79e-46aa-bc3b-7b3ae0be7d79 None None] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:30:23.100184 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-43f9236f-f79e-46aa-bc3b-7b3ae0be7d79 None None] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:30:23.125527 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_db.sqlalchemy.engines [None req-43f9236f-f79e-46aa-bc3b-7b3ae0be7d79 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102149) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Jun 24 16:30:23.126885 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_db.sqlalchemy.engines [None req-43f9236f-f79e-46aa-bc3b-7b3ae0be7d79 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102149) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Jun 24 16:30:23.139342 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.context [None req-fa65504a-2619-4dda-87c2-d0beb83a73ed None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),c009b6fd-523d-40a4-8f6f-3f0e03d98acc(cell1) {{(pid=102148) load_cells /opt/stack/nova/nova/context.py:464}} Jun 24 16:30:23.143706 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-fa65504a-2619-4dda-87c2-d0beb83a73ed None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:30:23.145487 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-fa65504a-2619-4dda-87c2-d0beb83a73ed None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:30:23.146243 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-fa65504a-2619-4dda-87c2-d0beb83a73ed None None] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:30:23.148270 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-fa65504a-2619-4dda-87c2-d0beb83a73ed None None] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:30:23.157994 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_db.sqlalchemy.engines [None req-43f9236f-f79e-46aa-bc3b-7b3ae0be7d79 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102149) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Jun 24 16:30:23.176834 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_db.sqlalchemy.engines [None req-fa65504a-2619-4dda-87c2-d0beb83a73ed None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102148) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Jun 24 16:30:23.177848 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_db.sqlalchemy.engines [None req-fa65504a-2619-4dda-87c2-d0beb83a73ed None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102148) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Jun 24 16:30:23.207477 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_db.sqlalchemy.engines [None req-fa65504a-2619-4dda-87c2-d0beb83a73ed None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102148) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Jun 24 16:30:23.404315 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO keyring.backend [None req-43f9236f-f79e-46aa-bc3b-7b3ae0be7d79 None None] Loading KWallet Jun 24 16:30:23.414722 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO keyring.backend [None req-43f9236f-f79e-46aa-bc3b-7b3ae0be7d79 None None] Loading SecretService Jun 24 16:30:23.418028 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 24 16:30:23.418028 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: from cryptography.utils import int_from_bytes Jun 24 16:30:23.418349 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 24 16:30:23.418349 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: from cryptography.utils import int_from_bytes Jun 24 16:30:23.419471 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO keyring.backend [None req-43f9236f-f79e-46aa-bc3b-7b3ae0be7d79 None None] Loading Windows Jun 24 16:30:23.421233 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO keyring.backend [None req-43f9236f-f79e-46aa-bc3b-7b3ae0be7d79 None None] Loading chainer Jun 24 16:30:23.422010 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO keyring.backend [None req-43f9236f-f79e-46aa-bc3b-7b3ae0be7d79 None None] Loading macOS Jun 24 16:30:23.456784 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO keyring.backend [None req-fa65504a-2619-4dda-87c2-d0beb83a73ed None None] Loading KWallet Jun 24 16:30:23.469841 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO keyring.backend [None req-fa65504a-2619-4dda-87c2-d0beb83a73ed None None] Loading SecretService Jun 24 16:30:23.473223 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 24 16:30:23.473223 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: from cryptography.utils import int_from_bytes Jun 24 16:30:23.473547 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 24 16:30:23.473547 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: from cryptography.utils import int_from_bytes Jun 24 16:30:23.474261 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO keyring.backend [None req-fa65504a-2619-4dda-87c2-d0beb83a73ed None None] Loading Windows Jun 24 16:30:23.476481 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO keyring.backend [None req-fa65504a-2619-4dda-87c2-d0beb83a73ed None None] Loading chainer Jun 24 16:30:23.477379 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO keyring.backend [None req-fa65504a-2619-4dda-87c2-d0beb83a73ed None None] Loading macOS Jun 24 16:30:23.680148 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: WARNING keystonemiddleware.auth_token [None req-43f9236f-f79e-46aa-bc3b-7b3ae0be7d79 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 24 16:30:23.687281 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: WARNING keystonemiddleware.auth_token [None req-43f9236f-f79e-46aa-bc3b-7b3ae0be7d79 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 24 16:30:23.734422 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: WARNING keystonemiddleware.auth_token [None req-fa65504a-2619-4dda-87c2-d0beb83a73ed None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 24 16:30:23.741084 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: WARNING keystonemiddleware.auth_token [None req-fa65504a-2619-4dda-87c2-d0beb83a73ed None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 24 16:30:23.903018 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: WARNING keystonemiddleware.auth_token [None req-43f9236f-f79e-46aa-bc3b-7b3ae0be7d79 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 24 16:30:23.908222 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: WARNING keystonemiddleware.auth_token [None req-43f9236f-f79e-46aa-bc3b-7b3ae0be7d79 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 24 16:30:23.913679 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55a9603169c0 pid: 102149 (default app) Jun 24 16:30:23.957756 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: WARNING keystonemiddleware.auth_token [None req-fa65504a-2619-4dda-87c2-d0beb83a73ed None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 24 16:30:23.963234 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: WARNING keystonemiddleware.auth_token [None req-fa65504a-2619-4dda-87c2-d0beb83a73ed None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 24 16:30:23.968822 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55a9603169c0 pid: 102148 (default app) Jun 24 16:31:09.576198 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-99cf51d6-568f-40cf-8575-ccc4e1469ae4 tempest-VolumesSnapshotsTestJSON-1073858564 tempest-VolumesSnapshotsTestJSON-1073858564-project] Action: 'create', calling method: .version_select at 0x7f1ae90a5e50>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1867934053"}} {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 16:31:11.739699 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-99cf51d6-568f-40cf-8575-ccc4e1469ae4 tempest-VolumesSnapshotsTestJSON-1073858564 tempest-VolumesSnapshotsTestJSON-1073858564-project] 10.222.0.18 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 3.979221 Jun 24 16:31:11.741703 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 1/1] 10.222.0.18 () {60 vars in 1154 bytes} [Fri Jun 24 16:31:07 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 3983 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jun 24 16:31:12.521093 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-9a429e2e-1c85-4bdc-b46e-dfa134483a83 tempest-VolumesSnapshotsTestJSON-1073858564 tempest-VolumesSnapshotsTestJSON-1073858564-project] Calling method '.version_select at 0x7f1ae9016e50>' {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:31:13.673634 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-9a429e2e-1c85-4bdc-b46e-dfa134483a83 tempest-VolumesSnapshotsTestJSON-1073858564 tempest-VolumesSnapshotsTestJSON-1073858564-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/ae26cee8-61cc-43b4-855b-2514d0f91e5c" status: 200 len: 346 microversion: 2.1 time: 1.922393 Jun 24 16:31:13.675136 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 1/2] 10.222.0.18 () {58 vars in 1244 bytes} [Fri Jun 24 16:31:11 2022] GET /compute/v2.1/os-volumes/ae26cee8-61cc-43b4-855b-2514d0f91e5c => generated 346 bytes in 1926 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 16:31:13.691942 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-d0645a1a-451b-4b37-9500-ab13878bd1f2 tempest-VolumesSnapshotsTestJSON-1073858564 tempest-VolumesSnapshotsTestJSON-1073858564-project] Action: 'create', calling method: .version_select at 0x7f1ae8fe9ca0>, body: {"snapshot": {"volume_id": "ae26cee8-61cc-43b4-855b-2514d0f91e5c", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-992199520"}} {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 16:31:14.281659 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-d0645a1a-451b-4b37-9500-ab13878bd1f2 tempest-VolumesSnapshotsTestJSON-1073858564 tempest-VolumesSnapshotsTestJSON-1073858564-project] 10.222.0.18 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.594324 Jun 24 16:31:14.282901 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 2/3] 10.222.0.18 () {60 vars in 1161 bytes} [Fri Jun 24 16:31:13 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 16:31:14.295297 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-552cafb9-5557-4aaa-b85a-6db3c2eea8ee tempest-VolumesSnapshotsTestJSON-1073858564 tempest-VolumesSnapshotsTestJSON-1073858564-project] Calling method '.version_select at 0x7f1ae8efd550>' {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:31:14.485446 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-552cafb9-5557-4aaa-b85a-6db3c2eea8ee tempest-VolumesSnapshotsTestJSON-1073858564 tempest-VolumesSnapshotsTestJSON-1073858564-project] 10.222.0.18 "GET /compute/v2.1/os-snapshots/49208020-bf09-4909-b91f-c1506860a549" status: 200 len: 286 microversion: 2.1 time: 0.194108 Jun 24 16:31:14.486651 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 2/4] 10.222.0.18 () {58 vars in 1250 bytes} [Fri Jun 24 16:31:14 2022] GET /compute/v2.1/os-snapshots/49208020-bf09-4909-b91f-c1506860a549 => generated 286 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 16:31:14.497220 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-b3e0357d-7e7b-40fa-a8a4-dca9a57a2fb4 tempest-VolumesSnapshotsTestJSON-1073858564 tempest-VolumesSnapshotsTestJSON-1073858564-project] Calling method '.version_select at 0x7f1ae8eb5ee0>' {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:31:14.588039 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-b3e0357d-7e7b-40fa-a8a4-dca9a57a2fb4 tempest-VolumesSnapshotsTestJSON-1073858564 tempest-VolumesSnapshotsTestJSON-1073858564-project] 10.222.0.18 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.094626 Jun 24 16:31:14.589038 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 3/5] 10.222.0.18 () {58 vars in 1139 bytes} [Fri Jun 24 16:31:14 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 16:31:14.599070 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-872ad3ce-0c99-4ec7-9ca9-19d4fc77babb tempest-VolumesSnapshotsTestJSON-1073858564 tempest-VolumesSnapshotsTestJSON-1073858564-project] Calling method '.version_select at 0x7f1ae8efde50>' {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:31:14.742970 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-872ad3ce-0c99-4ec7-9ca9-19d4fc77babb tempest-VolumesSnapshotsTestJSON-1073858564 tempest-VolumesSnapshotsTestJSON-1073858564-project] 10.222.0.18 "GET /compute/v2.1/os-snapshots/49208020-bf09-4909-b91f-c1506860a549" status: 200 len: 286 microversion: 2.1 time: 0.147491 Jun 24 16:31:14.744044 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 3/6] 10.222.0.18 () {58 vars in 1250 bytes} [Fri Jun 24 16:31:14 2022] GET /compute/v2.1/os-snapshots/49208020-bf09-4909-b91f-c1506860a549 => generated 286 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 16:31:15.754926 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-25f49825-12bf-474b-8f5a-8cf7bd015e74 tempest-VolumesSnapshotsTestJSON-1073858564 tempest-VolumesSnapshotsTestJSON-1073858564-project] Calling method '.version_select at 0x7f1ae8e454c0>' {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:31:15.857739 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-25f49825-12bf-474b-8f5a-8cf7bd015e74 tempest-VolumesSnapshotsTestJSON-1073858564 tempest-VolumesSnapshotsTestJSON-1073858564-project] 10.222.0.18 "GET /compute/v2.1/os-snapshots/49208020-bf09-4909-b91f-c1506860a549" status: 200 len: 286 microversion: 2.1 time: 0.106642 Jun 24 16:31:15.858302 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 4/7] 10.222.0.18 () {58 vars in 1250 bytes} [Fri Jun 24 16:31:15 2022] GET /compute/v2.1/os-snapshots/49208020-bf09-4909-b91f-c1506860a549 => generated 286 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 16:31:16.874265 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-d80a44d1-f728-467c-b88b-6f87826eb66a tempest-VolumesSnapshotsTestJSON-1073858564 tempest-VolumesSnapshotsTestJSON-1073858564-project] Calling method '.version_select at 0x7f1ae8eb4790>' {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:31:17.052704 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-d80a44d1-f728-467c-b88b-6f87826eb66a tempest-VolumesSnapshotsTestJSON-1073858564 tempest-VolumesSnapshotsTestJSON-1073858564-project] 10.222.0.18 "GET /compute/v2.1/os-snapshots/49208020-bf09-4909-b91f-c1506860a549" status: 200 len: 286 microversion: 2.1 time: 0.184843 Jun 24 16:31:17.054660 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 4/8] 10.222.0.18 () {58 vars in 1250 bytes} [Fri Jun 24 16:31:16 2022] GET /compute/v2.1/os-snapshots/49208020-bf09-4909-b91f-c1506860a549 => generated 286 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 16:31:18.074562 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-97dd94ac-5ccf-4d0f-ba18-821a29ccf48c tempest-VolumesSnapshotsTestJSON-1073858564 tempest-VolumesSnapshotsTestJSON-1073858564-project] Calling method '.version_select at 0x7f1ae8eb4f70>' {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:31:18.167903 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-6dd65538-eecf-4f2e-9bc2-4e3ecc2127a0 tempest-DeleteServersTestJSON-368419735 tempest-DeleteServersTestJSON-368419735-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-688242515", "imageRef": "113c9cfb-6cee-4018-9e63-66fae82b3851", "flavorRef": "452", "networks": [{"uuid": "5a0c7d8b-0c0e-410a-91b3-8fa745717c1a"}]}} {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 16:31:18.196496 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-97dd94ac-5ccf-4d0f-ba18-821a29ccf48c tempest-VolumesSnapshotsTestJSON-1073858564 tempest-VolumesSnapshotsTestJSON-1073858564-project] 10.222.0.18 "GET /compute/v2.1/os-snapshots/49208020-bf09-4909-b91f-c1506860a549" status: 200 len: 287 microversion: 2.1 time: 0.130583 Jun 24 16:31:18.197061 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 5/9] 10.222.0.18 () {58 vars in 1250 bytes} [Fri Jun 24 16:31:18 2022] GET /compute/v2.1/os-snapshots/49208020-bf09-4909-b91f-c1506860a549 => generated 287 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 16:31:18.211650 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-65d778d5-9e2f-4746-947f-676ac460b079 tempest-VolumesSnapshotsTestJSON-1073858564 tempest-VolumesSnapshotsTestJSON-1073858564-project] Calling method '.version_select at 0x7f1ae8eb4550>' {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:31:18.376586 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.network.neutron [None req-6dd65538-eecf-4f2e-9bc2-4e3ecc2127a0 tempest-DeleteServersTestJSON-368419735 tempest-DeleteServersTestJSON-368419735-project] validate_networks() for [('5a0c7d8b-0c0e-410a-91b3-8fa745717c1a', None, None, None)] {{(pid=102149) validate_networks /opt/stack/nova/nova/network/neutron.py:2367}} Jun 24 16:31:18.491978 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-65d778d5-9e2f-4746-947f-676ac460b079 tempest-VolumesSnapshotsTestJSON-1073858564 tempest-VolumesSnapshotsTestJSON-1073858564-project] 10.222.0.18 "DELETE /compute/v2.1/os-snapshots/49208020-bf09-4909-b91f-c1506860a549" status: 202 len: 0 microversion: 2.1 time: 0.284168 Jun 24 16:31:18.493074 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 6/10] 10.222.0.18 () {58 vars in 1253 bytes} [Fri Jun 24 16:31:18 2022] DELETE /compute/v2.1/os-snapshots/49208020-bf09-4909-b91f-c1506860a549 => generated 0 bytes in 287 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 24 16:31:18.501180 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-c8e20e22-5a4b-4bec-bf4b-cf90d09c2d3d tempest-VolumesSnapshotsTestJSON-1073858564 tempest-VolumesSnapshotsTestJSON-1073858564-project] Calling method '.version_select at 0x7f1ae8efde50>' {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:31:18.597108 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-c8e20e22-5a4b-4bec-bf4b-cf90d09c2d3d tempest-VolumesSnapshotsTestJSON-1073858564 tempest-VolumesSnapshotsTestJSON-1073858564-project] 10.222.0.18 "GET /compute/v2.1/os-snapshots/49208020-bf09-4909-b91f-c1506860a549" status: 200 len: 286 microversion: 2.1 time: 0.099899 Jun 24 16:31:18.598203 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 7/11] 10.222.0.18 () {58 vars in 1250 bytes} [Fri Jun 24 16:31:18 2022] GET /compute/v2.1/os-snapshots/49208020-bf09-4909-b91f-c1506860a549 => generated 286 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 16:31:19.613979 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-19b3c1bc-af85-4167-bd56-59a476588b33 tempest-VolumesSnapshotsTestJSON-1073858564 tempest-VolumesSnapshotsTestJSON-1073858564-project] Calling method '.version_select at 0x7f1ae8eb4160>' {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:31:19.718499 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.wsgi [None req-19b3c1bc-af85-4167-bd56-59a476588b33 tempest-VolumesSnapshotsTestJSON-1073858564 tempest-VolumesSnapshotsTestJSON-1073858564-project] HTTP exception thrown: Snapshot 49208020-bf09-4909-b91f-c1506860a549 could not be found. Jun 24 16:31:19.719803 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-19b3c1bc-af85-4167-bd56-59a476588b33 tempest-VolumesSnapshotsTestJSON-1073858564 tempest-VolumesSnapshotsTestJSON-1073858564-project] Returning 404 to user: Snapshot 49208020-bf09-4909-b91f-c1506860a549 could not be found. {{(pid=102148) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jun 24 16:31:19.720884 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-19b3c1bc-af85-4167-bd56-59a476588b33 tempest-VolumesSnapshotsTestJSON-1073858564 tempest-VolumesSnapshotsTestJSON-1073858564-project] 10.222.0.18 "GET /compute/v2.1/os-snapshots/49208020-bf09-4909-b91f-c1506860a549" status: 404 len: 111 microversion: 2.1 time: 0.115443 Jun 24 16:31:19.721662 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 8/12] 10.222.0.18 () {58 vars in 1250 bytes} [Fri Jun 24 16:31:19 2022] GET /compute/v2.1/os-snapshots/49208020-bf09-4909-b91f-c1506860a549 => generated 111 bytes in 117 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 16:31:19.733177 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-67020f06-7c37-4e5e-8971-0e0524a1aff7 tempest-VolumesSnapshotsTestJSON-1073858564 tempest-VolumesSnapshotsTestJSON-1073858564-project] Calling method '.version_select at 0x7f1ae951d280>' {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:31:19.977612 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-67020f06-7c37-4e5e-8971-0e0524a1aff7 tempest-VolumesSnapshotsTestJSON-1073858564 tempest-VolumesSnapshotsTestJSON-1073858564-project] 10.222.0.18 "DELETE /compute/v2.1/os-volumes/ae26cee8-61cc-43b4-855b-2514d0f91e5c" status: 202 len: 0 microversion: 2.1 time: 0.250477 Jun 24 16:31:19.980633 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 9/13] 10.222.0.18 () {58 vars in 1247 bytes} [Fri Jun 24 16:31:19 2022] DELETE /compute/v2.1/os-volumes/ae26cee8-61cc-43b4-855b-2514d0f91e5c => generated 0 bytes in 255 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 24 16:31:19.992036 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-06648fef-063a-426b-a6f4-6a9f0cc17712 tempest-VolumesSnapshotsTestJSON-1073858564 tempest-VolumesSnapshotsTestJSON-1073858564-project] Calling method '.version_select at 0x7f1ae8eb49d0>' {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:31:20.131007 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-06648fef-063a-426b-a6f4-6a9f0cc17712 tempest-VolumesSnapshotsTestJSON-1073858564 tempest-VolumesSnapshotsTestJSON-1073858564-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/ae26cee8-61cc-43b4-855b-2514d0f91e5c" status: 200 len: 345 microversion: 2.1 time: 0.144942 Jun 24 16:31:20.132840 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 10/14] 10.222.0.18 () {58 vars in 1244 bytes} [Fri Jun 24 16:31:19 2022] GET /compute/v2.1/os-volumes/ae26cee8-61cc-43b4-855b-2514d0f91e5c => generated 345 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 16:31:21.145106 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-3c21427b-653f-4f81-9435-fac0eca509cb tempest-VolumesSnapshotsTestJSON-1073858564 tempest-VolumesSnapshotsTestJSON-1073858564-project] Calling method '.version_select at 0x7f1ae8efd700>' {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:31:21.297609 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.wsgi [None req-3c21427b-653f-4f81-9435-fac0eca509cb tempest-VolumesSnapshotsTestJSON-1073858564 tempest-VolumesSnapshotsTestJSON-1073858564-project] HTTP exception thrown: Volume ae26cee8-61cc-43b4-855b-2514d0f91e5c could not be found. Jun 24 16:31:21.298296 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-3c21427b-653f-4f81-9435-fac0eca509cb tempest-VolumesSnapshotsTestJSON-1073858564 tempest-VolumesSnapshotsTestJSON-1073858564-project] Returning 404 to user: Volume ae26cee8-61cc-43b4-855b-2514d0f91e5c could not be found. {{(pid=102148) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jun 24 16:31:21.299475 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-3c21427b-653f-4f81-9435-fac0eca509cb tempest-VolumesSnapshotsTestJSON-1073858564 tempest-VolumesSnapshotsTestJSON-1073858564-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/ae26cee8-61cc-43b4-855b-2514d0f91e5c" status: 404 len: 109 microversion: 2.1 time: 0.158390 Jun 24 16:31:21.300114 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 11/15] 10.222.0.18 () {58 vars in 1244 bytes} [Fri Jun 24 16:31:21 2022] GET /compute/v2.1/os-volumes/ae26cee8-61cc-43b4-855b-2514d0f91e5c => generated 109 bytes in 160 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 24 16:31:21.314256 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-d9554587-b58d-433c-8441-e618316e2140 tempest-VolumesSnapshotsTestJSON-1073858564 tempest-VolumesSnapshotsTestJSON-1073858564-project] Calling method '.version_select at 0x7f1ae8efd550>' {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:31:21.557980 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.wsgi [None req-d9554587-b58d-433c-8441-e618316e2140 tempest-VolumesSnapshotsTestJSON-1073858564 tempest-VolumesSnapshotsTestJSON-1073858564-project] HTTP exception thrown: Volume ae26cee8-61cc-43b4-855b-2514d0f91e5c could not be found. Jun 24 16:31:21.558605 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-d9554587-b58d-433c-8441-e618316e2140 tempest-VolumesSnapshotsTestJSON-1073858564 tempest-VolumesSnapshotsTestJSON-1073858564-project] Returning 404 to user: Volume ae26cee8-61cc-43b4-855b-2514d0f91e5c could not be found. {{(pid=102148) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jun 24 16:31:21.559999 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-d9554587-b58d-433c-8441-e618316e2140 tempest-VolumesSnapshotsTestJSON-1073858564 tempest-VolumesSnapshotsTestJSON-1073858564-project] 10.222.0.18 "DELETE /compute/v2.1/os-volumes/ae26cee8-61cc-43b4-855b-2514d0f91e5c" status: 404 len: 109 microversion: 2.1 time: 0.249854 Jun 24 16:31:21.560549 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 12/16] 10.222.0.18 () {58 vars in 1247 bytes} [Fri Jun 24 16:31:21 2022] DELETE /compute/v2.1/os-volumes/ae26cee8-61cc-43b4-855b-2514d0f91e5c => generated 109 bytes in 251 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 16:31:21.570062 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-92e71862-2325-4e13-ba07-c06ebd0e8703 tempest-VolumesSnapshotsTestJSON-1073858564 tempest-VolumesSnapshotsTestJSON-1073858564-project] Calling method '.version_select at 0x7f1ae8eb4f70>' {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:31:21.718215 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.wsgi [None req-92e71862-2325-4e13-ba07-c06ebd0e8703 tempest-VolumesSnapshotsTestJSON-1073858564 tempest-VolumesSnapshotsTestJSON-1073858564-project] HTTP exception thrown: Volume ae26cee8-61cc-43b4-855b-2514d0f91e5c could not be found. Jun 24 16:31:21.719602 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-92e71862-2325-4e13-ba07-c06ebd0e8703 tempest-VolumesSnapshotsTestJSON-1073858564 tempest-VolumesSnapshotsTestJSON-1073858564-project] Returning 404 to user: Volume ae26cee8-61cc-43b4-855b-2514d0f91e5c could not be found. {{(pid=102148) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jun 24 16:31:21.721117 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-92e71862-2325-4e13-ba07-c06ebd0e8703 tempest-VolumesSnapshotsTestJSON-1073858564 tempest-VolumesSnapshotsTestJSON-1073858564-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/ae26cee8-61cc-43b4-855b-2514d0f91e5c" status: 404 len: 109 microversion: 2.1 time: 0.156247 Jun 24 16:31:21.721839 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 13/17] 10.222.0.18 () {58 vars in 1244 bytes} [Fri Jun 24 16:31:21 2022] GET /compute/v2.1/os-volumes/ae26cee8-61cc-43b4-855b-2514d0f91e5c => generated 109 bytes in 157 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 16:31:22.279616 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.virt.hardware [None req-6dd65538-eecf-4f2e-9bc2-4e3ecc2127a0 tempest-DeleteServersTestJSON-368419735 tempest-DeleteServersTestJSON-368419735-project] Flavor limits 0:0:0 {{(pid=102149) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 24 16:31:22.280301 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.virt.hardware [None req-6dd65538-eecf-4f2e-9bc2-4e3ecc2127a0 tempest-DeleteServersTestJSON-368419735 tempest-DeleteServersTestJSON-368419735-project] Image limits 0:0:0 {{(pid=102149) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 24 16:31:22.281060 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.virt.hardware [None req-6dd65538-eecf-4f2e-9bc2-4e3ecc2127a0 tempest-DeleteServersTestJSON-368419735 tempest-DeleteServersTestJSON-368419735-project] Flavor pref 0:0:0 {{(pid=102149) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 24 16:31:22.281696 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.virt.hardware [None req-6dd65538-eecf-4f2e-9bc2-4e3ecc2127a0 tempest-DeleteServersTestJSON-368419735 tempest-DeleteServersTestJSON-368419735-project] Image pref 0:0:0 {{(pid=102149) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 24 16:31:22.282343 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.virt.hardware [None req-6dd65538-eecf-4f2e-9bc2-4e3ecc2127a0 tempest-DeleteServersTestJSON-368419735 tempest-DeleteServersTestJSON-368419735-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=102149) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 24 16:31:22.340608 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-6dd65538-eecf-4f2e-9bc2-4e3ecc2127a0 tempest-DeleteServersTestJSON-368419735 tempest-DeleteServersTestJSON-368419735-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:31:22.341295 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-6dd65538-eecf-4f2e-9bc2-4e3ecc2127a0 tempest-DeleteServersTestJSON-368419735 tempest-DeleteServersTestJSON-368419735-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:31:22.342576 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-6dd65538-eecf-4f2e-9bc2-4e3ecc2127a0 tempest-DeleteServersTestJSON-368419735 tempest-DeleteServersTestJSON-368419735-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:31:22.353965 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-6dd65538-eecf-4f2e-9bc2-4e3ecc2127a0 tempest-DeleteServersTestJSON-368419735 tempest-DeleteServersTestJSON-368419735-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:31:22.482178 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.quota [None req-6dd65538-eecf-4f2e-9bc2-4e3ecc2127a0 tempest-DeleteServersTestJSON-368419735 tempest-DeleteServersTestJSON-368419735-project] Getting quotas for project 166c04f72691440d883f2508cc22df58. Resources: {'ram', 'instances', 'cores'} {{(pid=102149) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jun 24 16:31:22.510403 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.quota [None req-6dd65538-eecf-4f2e-9bc2-4e3ecc2127a0 tempest-DeleteServersTestJSON-368419735 tempest-DeleteServersTestJSON-368419735-project] Getting quotas for user 81eaf76db05e41feb86cb793787bdeac and project 166c04f72691440d883f2508cc22df58. Resources: {'ram', 'instances', 'cores'} {{(pid=102149) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jun 24 16:31:22.571794 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-6dd65538-eecf-4f2e-9bc2-4e3ecc2127a0 tempest-DeleteServersTestJSON-368419735 tempest-DeleteServersTestJSON-368419735-project] Going to run 1 instances... {{(pid=102149) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Jun 24 16:31:22.616098 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-6dd65538-eecf-4f2e-9bc2-4e3ecc2127a0 tempest-DeleteServersTestJSON-368419735 tempest-DeleteServersTestJSON-368419735-project] [instance: 618dfcb0-fc23-4985-a7e0-9ec51837519b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='113c9cfb-6cee-4018-9e63-66fae82b3851',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=102149) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1684}} Jun 24 16:31:22.921021 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-6dd65538-eecf-4f2e-9bc2-4e3ecc2127a0 tempest-DeleteServersTestJSON-368419735 tempest-DeleteServersTestJSON-368419735-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.951924 Jun 24 16:31:22.931990 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 5/18] 10.222.0.18 () {60 vars in 1146 bytes} [Fri Jun 24 16:31:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 4966 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 24 16:31:22.941047 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-6572748f-efc9-4cba-8ee0-a477014b68cf tempest-DeleteServersTestJSON-368419735 tempest-DeleteServersTestJSON-368419735-project] Calling method '>' {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:31:22.942361 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-6572748f-efc9-4cba-8ee0-a477014b68cf tempest-DeleteServersTestJSON-368419735 tempest-DeleteServersTestJSON-368419735-project] [instance: 618dfcb0-fc23-4985-a7e0-9ec51837519b] Fetching instance by UUID {{(pid=102148) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:31:23.440355 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-6572748f-efc9-4cba-8ee0-a477014b68cf tempest-DeleteServersTestJSON-368419735 tempest-DeleteServersTestJSON-368419735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81eaf76db05e41feb86cb793787bdeac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '166c04f72691440d883f2508cc22df58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:31:23.456862 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-6572748f-efc9-4cba-8ee0-a477014b68cf tempest-DeleteServersTestJSON-368419735 tempest-DeleteServersTestJSON-368419735-project] 10.222.0.18 "GET /compute/v2.1/servers/618dfcb0-fc23-4985-a7e0-9ec51837519b" status: 200 len: 1214 microversion: 2.1 time: 0.523957 Jun 24 16:31:23.463098 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 14/19] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:31:22 2022] GET /compute/v2.1/servers/618dfcb0-fc23-4985-a7e0-9ec51837519b => generated 1214 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 16:31:24.483567 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-d7eb8ae1-9d8c-4f03-8881-b9beb230d2fd tempest-DeleteServersTestJSON-368419735 tempest-DeleteServersTestJSON-368419735-project] Calling method '>' {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:31:24.484198 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-d7eb8ae1-9d8c-4f03-8881-b9beb230d2fd tempest-DeleteServersTestJSON-368419735 tempest-DeleteServersTestJSON-368419735-project] [instance: 618dfcb0-fc23-4985-a7e0-9ec51837519b] Fetching instance by UUID {{(pid=102149) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:31:25.457396 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-d7eb8ae1-9d8c-4f03-8881-b9beb230d2fd tempest-DeleteServersTestJSON-368419735 tempest-DeleteServersTestJSON-368419735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81eaf76db05e41feb86cb793787bdeac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '166c04f72691440d883f2508cc22df58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:31:25.495532 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-d7eb8ae1-9d8c-4f03-8881-b9beb230d2fd tempest-DeleteServersTestJSON-368419735 tempest-DeleteServersTestJSON-368419735-project] 10.222.0.18 "GET /compute/v2.1/servers/618dfcb0-fc23-4985-a7e0-9ec51837519b" status: 200 len: 1214 microversion: 2.1 time: 1.009693 Jun 24 16:31:25.511817 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 6/20] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:31:24 2022] GET /compute/v2.1/servers/618dfcb0-fc23-4985-a7e0-9ec51837519b => generated 1214 bytes in 1034 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 16:31:26.515115 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-16b3240f-75a0-4db1-8725-867ec735b91d tempest-DeleteServersTestJSON-368419735 tempest-DeleteServersTestJSON-368419735-project] Calling method '>' {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:31:26.515648 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-16b3240f-75a0-4db1-8725-867ec735b91d tempest-DeleteServersTestJSON-368419735 tempest-DeleteServersTestJSON-368419735-project] [instance: 618dfcb0-fc23-4985-a7e0-9ec51837519b] Fetching instance by UUID {{(pid=102148) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:31:26.552229 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-16b3240f-75a0-4db1-8725-867ec735b91d tempest-DeleteServersTestJSON-368419735 tempest-DeleteServersTestJSON-368419735-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:31:26.552713 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-16b3240f-75a0-4db1-8725-867ec735b91d tempest-DeleteServersTestJSON-368419735 tempest-DeleteServersTestJSON-368419735-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:31:26.559890 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-16b3240f-75a0-4db1-8725-867ec735b91d tempest-DeleteServersTestJSON-368419735 tempest-DeleteServersTestJSON-368419735-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:31:26.562961 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-16b3240f-75a0-4db1-8725-867ec735b91d tempest-DeleteServersTestJSON-368419735 tempest-DeleteServersTestJSON-368419735-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:31:27.656090 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-16b3240f-75a0-4db1-8725-867ec735b91d tempest-DeleteServersTestJSON-368419735 tempest-DeleteServersTestJSON-368419735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81eaf76db05e41feb86cb793787bdeac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '166c04f72691440d883f2508cc22df58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:31:27.698412 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-16b3240f-75a0-4db1-8725-867ec735b91d tempest-DeleteServersTestJSON-368419735 tempest-DeleteServersTestJSON-368419735-project] 10.222.0.18 "GET /compute/v2.1/servers/618dfcb0-fc23-4985-a7e0-9ec51837519b" status: 200 len: 1274 microversion: 2.1 time: 1.186344 Jun 24 16:31:27.700908 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 15/21] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:31:26 2022] GET /compute/v2.1/servers/618dfcb0-fc23-4985-a7e0-9ec51837519b => generated 1274 bytes in 1191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 16:31:28.726451 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-c3cec06e-5cc8-4a28-ac68-d3127599b9b6 tempest-DeleteServersTestJSON-368419735 tempest-DeleteServersTestJSON-368419735-project] Calling method '>' {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:31:28.727193 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-c3cec06e-5cc8-4a28-ac68-d3127599b9b6 tempest-DeleteServersTestJSON-368419735 tempest-DeleteServersTestJSON-368419735-project] [instance: 618dfcb0-fc23-4985-a7e0-9ec51837519b] Fetching instance by UUID {{(pid=102149) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:31:28.756958 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-c3cec06e-5cc8-4a28-ac68-d3127599b9b6 tempest-DeleteServersTestJSON-368419735 tempest-DeleteServersTestJSON-368419735-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:31:28.768102 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-c3cec06e-5cc8-4a28-ac68-d3127599b9b6 tempest-DeleteServersTestJSON-368419735 tempest-DeleteServersTestJSON-368419735-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:31:28.770733 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-c3cec06e-5cc8-4a28-ac68-d3127599b9b6 tempest-DeleteServersTestJSON-368419735 tempest-DeleteServersTestJSON-368419735-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:31:28.771679 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-c3cec06e-5cc8-4a28-ac68-d3127599b9b6 tempest-DeleteServersTestJSON-368419735 tempest-DeleteServersTestJSON-368419735-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:31:29.633524 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-c3cec06e-5cc8-4a28-ac68-d3127599b9b6 tempest-DeleteServersTestJSON-368419735 tempest-DeleteServersTestJSON-368419735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81eaf76db05e41feb86cb793787bdeac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '166c04f72691440d883f2508cc22df58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:31:29.656167 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-c3cec06e-5cc8-4a28-ac68-d3127599b9b6 tempest-DeleteServersTestJSON-368419735 tempest-DeleteServersTestJSON-368419735-project] 10.222.0.18 "GET /compute/v2.1/servers/618dfcb0-fc23-4985-a7e0-9ec51837519b" status: 200 len: 1272 microversion: 2.1 time: 0.934665 Jun 24 16:31:29.668321 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 7/22] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:31:28 2022] GET /compute/v2.1/servers/618dfcb0-fc23-4985-a7e0-9ec51837519b => generated 1272 bytes in 947 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 16:31:30.697055 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-b15989e5-1c3a-493e-bfd1-030d3d9550a0 tempest-DeleteServersTestJSON-368419735 tempest-DeleteServersTestJSON-368419735-project] Calling method '>' {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:31:30.698160 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-b15989e5-1c3a-493e-bfd1-030d3d9550a0 tempest-DeleteServersTestJSON-368419735 tempest-DeleteServersTestJSON-368419735-project] [instance: 618dfcb0-fc23-4985-a7e0-9ec51837519b] Fetching instance by UUID {{(pid=102148) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:31:30.755802 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-b15989e5-1c3a-493e-bfd1-030d3d9550a0 tempest-DeleteServersTestJSON-368419735 tempest-DeleteServersTestJSON-368419735-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:31:30.758450 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-b15989e5-1c3a-493e-bfd1-030d3d9550a0 tempest-DeleteServersTestJSON-368419735 tempest-DeleteServersTestJSON-368419735-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:31:30.770411 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-b15989e5-1c3a-493e-bfd1-030d3d9550a0 tempest-DeleteServersTestJSON-368419735 tempest-DeleteServersTestJSON-368419735-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:31:30.772150 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-b15989e5-1c3a-493e-bfd1-030d3d9550a0 tempest-DeleteServersTestJSON-368419735 tempest-DeleteServersTestJSON-368419735-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:31:31.761553 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-b78b0830-e29b-486d-b823-c1091eba567f tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Action: 'create', calling method: .version_select at 0x7f1ae84d6670>, body: {"keypair": {"name": "tempest-keypair-116280810", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEQyAEeUUS3CbFXdxinUP1aGjwsUwNdMgKlG3aMBgcy6Z/t5x+lS6V9nvkpYqbM7XlF4HWMm/T8L7eSOGhAmnZifNPvDWnpDjKbaUD/lxBjf6Xeo9tQ7cuUOi5pfivLRHA=="}} {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 16:31:31.879184 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.quota [None req-b78b0830-e29b-486d-b823-c1091eba567f tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Getting quotas for project 065254ebe67545639644fcbc6bd9fc31. Resources: {'key_pairs'} {{(pid=102149) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jun 24 16:31:31.893612 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.quota [None req-b78b0830-e29b-486d-b823-c1091eba567f tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Getting quotas for user 7489b29cb3ef47d78dfd55794f338b27 and project 065254ebe67545639644fcbc6bd9fc31. Resources: {'key_pairs'} {{(pid=102149) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jun 24 16:31:32.011751 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-b78b0830-e29b-486d-b823-c1091eba567f tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.692029 Jun 24 16:31:32.013628 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 8/23] 10.222.0.18 () {62 vars in 1199 bytes} [Fri Jun 24 16:31:31 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 696 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Jun 24 16:31:32.276529 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-b15989e5-1c3a-493e-bfd1-030d3d9550a0 tempest-DeleteServersTestJSON-368419735 tempest-DeleteServersTestJSON-368419735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81eaf76db05e41feb86cb793787bdeac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '166c04f72691440d883f2508cc22df58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:31:32.288747 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-b15989e5-1c3a-493e-bfd1-030d3d9550a0 tempest-DeleteServersTestJSON-368419735 tempest-DeleteServersTestJSON-368419735-project] 10.222.0.18 "GET /compute/v2.1/servers/618dfcb0-fc23-4985-a7e0-9ec51837519b" status: 200 len: 1314 microversion: 2.1 time: 1.598307 Jun 24 16:31:32.315318 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 16/24] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:31:30 2022] GET /compute/v2.1/servers/618dfcb0-fc23-4985-a7e0-9ec51837519b => generated 1314 bytes in 1626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 16:31:33.324439 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-91a26b18-37d5-4942-90be-9ac7268109e6 tempest-DeleteServersTestJSON-368419735 tempest-DeleteServersTestJSON-368419735-project] Calling method '>' {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:31:33.325912 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-91a26b18-37d5-4942-90be-9ac7268109e6 tempest-DeleteServersTestJSON-368419735 tempest-DeleteServersTestJSON-368419735-project] [instance: 618dfcb0-fc23-4985-a7e0-9ec51837519b] Fetching instance by UUID {{(pid=102149) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:31:33.350898 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-91a26b18-37d5-4942-90be-9ac7268109e6 tempest-DeleteServersTestJSON-368419735 tempest-DeleteServersTestJSON-368419735-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:31:33.351719 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-91a26b18-37d5-4942-90be-9ac7268109e6 tempest-DeleteServersTestJSON-368419735 tempest-DeleteServersTestJSON-368419735-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:31:33.352748 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-91a26b18-37d5-4942-90be-9ac7268109e6 tempest-DeleteServersTestJSON-368419735 tempest-DeleteServersTestJSON-368419735-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:31:33.353936 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-91a26b18-37d5-4942-90be-9ac7268109e6 tempest-DeleteServersTestJSON-368419735 tempest-DeleteServersTestJSON-368419735-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:31:35.997852 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-91a26b18-37d5-4942-90be-9ac7268109e6 tempest-DeleteServersTestJSON-368419735 tempest-DeleteServersTestJSON-368419735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81eaf76db05e41feb86cb793787bdeac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '166c04f72691440d883f2508cc22df58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:31:36.011374 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-91a26b18-37d5-4942-90be-9ac7268109e6 tempest-DeleteServersTestJSON-368419735 tempest-DeleteServersTestJSON-368419735-project] 10.222.0.18 "GET /compute/v2.1/servers/618dfcb0-fc23-4985-a7e0-9ec51837519b" status: 200 len: 1314 microversion: 2.1 time: 2.692394 Jun 24 16:31:36.015694 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 9/25] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:31:33 2022] GET /compute/v2.1/servers/618dfcb0-fc23-4985-a7e0-9ec51837519b => generated 1314 bytes in 2698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 16:31:37.051488 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-b08a50db-96e2-48d5-9db1-30766d8fa00f tempest-DeleteServersTestJSON-368419735 tempest-DeleteServersTestJSON-368419735-project] Calling method '>' {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:31:37.052600 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-b08a50db-96e2-48d5-9db1-30766d8fa00f tempest-DeleteServersTestJSON-368419735 tempest-DeleteServersTestJSON-368419735-project] [instance: 618dfcb0-fc23-4985-a7e0-9ec51837519b] Fetching instance by UUID {{(pid=102149) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:31:37.074144 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-b08a50db-96e2-48d5-9db1-30766d8fa00f tempest-DeleteServersTestJSON-368419735 tempest-DeleteServersTestJSON-368419735-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:31:37.074600 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-b08a50db-96e2-48d5-9db1-30766d8fa00f tempest-DeleteServersTestJSON-368419735 tempest-DeleteServersTestJSON-368419735-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:31:37.075404 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-b08a50db-96e2-48d5-9db1-30766d8fa00f tempest-DeleteServersTestJSON-368419735 tempest-DeleteServersTestJSON-368419735-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:31:37.075999 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-b08a50db-96e2-48d5-9db1-30766d8fa00f tempest-DeleteServersTestJSON-368419735 tempest-DeleteServersTestJSON-368419735-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:31:37.767251 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-6345e038-f9a1-4f74-831e-8d74a69a3c03 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Action: 'create', calling method: .version_select at 0x7f1ae8d8a430>, body: {"keypair": {"name": "tempest-keypair-1345199728", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMUH7D5Hxn0OtCTFzWNTbsTZ+4E+RJvrRr0IIj4y/LVQRpzuKItWp6onXQrcvZ8NHz/AzBWnL3pbQod5PJVLXsF0PmllaLWL5Et8k+TlWx48Gmn/ciV4oYTQmWQAcY6mlA=="}} {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 16:31:37.982057 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.quota [None req-6345e038-f9a1-4f74-831e-8d74a69a3c03 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Getting quotas for project 606ba814a2d8408ab0856d539ca79b4f. Resources: {'key_pairs'} {{(pid=102148) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jun 24 16:31:38.006848 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.quota [None req-6345e038-f9a1-4f74-831e-8d74a69a3c03 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Getting quotas for user 499faf87cf8c41ae823b2566e4c2d8ce and project 606ba814a2d8408ab0856d539ca79b4f. Resources: {'key_pairs'} {{(pid=102148) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jun 24 16:31:38.205759 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-6345e038-f9a1-4f74-831e-8d74a69a3c03 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 1.352965 Jun 24 16:31:38.207820 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 17/26] 10.222.0.18 () {60 vars in 1158 bytes} [Fri Jun 24 16:31:36 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 1356 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 16:31:40.283375 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-b08a50db-96e2-48d5-9db1-30766d8fa00f tempest-DeleteServersTestJSON-368419735 tempest-DeleteServersTestJSON-368419735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81eaf76db05e41feb86cb793787bdeac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '166c04f72691440d883f2508cc22df58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:31:40.305448 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-b08a50db-96e2-48d5-9db1-30766d8fa00f tempest-DeleteServersTestJSON-368419735 tempest-DeleteServersTestJSON-368419735-project] 10.222.0.18 "GET /compute/v2.1/servers/618dfcb0-fc23-4985-a7e0-9ec51837519b" status: 200 len: 1314 microversion: 2.1 time: 3.257452 Jun 24 16:31:40.325473 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 10/27] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:31:37 2022] GET /compute/v2.1/servers/618dfcb0-fc23-4985-a7e0-9ec51837519b => generated 1314 bytes in 3277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 16:31:41.324024 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-2ea91e7d-66b1-4490-9309-79d1f70a3c21 tempest-DeleteServersTestJSON-368419735 tempest-DeleteServersTestJSON-368419735-project] Calling method '>' {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:31:41.327682 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-2ea91e7d-66b1-4490-9309-79d1f70a3c21 tempest-DeleteServersTestJSON-368419735 tempest-DeleteServersTestJSON-368419735-project] [instance: 618dfcb0-fc23-4985-a7e0-9ec51837519b] Fetching instance by UUID {{(pid=102148) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:31:41.351522 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-2ea91e7d-66b1-4490-9309-79d1f70a3c21 tempest-DeleteServersTestJSON-368419735 tempest-DeleteServersTestJSON-368419735-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:31:41.358368 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-2ea91e7d-66b1-4490-9309-79d1f70a3c21 tempest-DeleteServersTestJSON-368419735 tempest-DeleteServersTestJSON-368419735-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:31:41.364277 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-2ea91e7d-66b1-4490-9309-79d1f70a3c21 tempest-DeleteServersTestJSON-368419735 tempest-DeleteServersTestJSON-368419735-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:31:41.366903 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-2ea91e7d-66b1-4490-9309-79d1f70a3c21 tempest-DeleteServersTestJSON-368419735 tempest-DeleteServersTestJSON-368419735-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:31:42.598764 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-f2b5ef71-65fe-4c2e-bf45-5f34fb59b5f3 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-265079443", "imageRef": "113c9cfb-6cee-4018-9e63-66fae82b3851", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 16:31:42.865762 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.network.neutron [None req-f2b5ef71-65fe-4c2e-bf45-5f34fb59b5f3 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] validate_networks() for [('e798456c-6e0e-4eb9-9c41-fac0ea090965', None, None, None)] {{(pid=102149) validate_networks /opt/stack/nova/nova/network/neutron.py:2367}} Jun 24 16:31:44.773483 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-2ea91e7d-66b1-4490-9309-79d1f70a3c21 tempest-DeleteServersTestJSON-368419735 tempest-DeleteServersTestJSON-368419735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81eaf76db05e41feb86cb793787bdeac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '166c04f72691440d883f2508cc22df58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:31:44.795135 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-2ea91e7d-66b1-4490-9309-79d1f70a3c21 tempest-DeleteServersTestJSON-368419735 tempest-DeleteServersTestJSON-368419735-project] 10.222.0.18 "GET /compute/v2.1/servers/618dfcb0-fc23-4985-a7e0-9ec51837519b" status: 200 len: 1314 microversion: 2.1 time: 3.475488 Jun 24 16:31:44.815233 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 18/28] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:31:41 2022] GET /compute/v2.1/servers/618dfcb0-fc23-4985-a7e0-9ec51837519b => generated 1314 bytes in 3497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 16:31:45.845739 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-166bd648-4a88-4ff9-9117-19a247da0c82 tempest-DeleteServersTestJSON-368419735 tempest-DeleteServersTestJSON-368419735-project] Calling method '>' {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:31:45.852172 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-166bd648-4a88-4ff9-9117-19a247da0c82 tempest-DeleteServersTestJSON-368419735 tempest-DeleteServersTestJSON-368419735-project] [instance: 618dfcb0-fc23-4985-a7e0-9ec51837519b] Fetching instance by UUID {{(pid=102148) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:31:45.903610 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-166bd648-4a88-4ff9-9117-19a247da0c82 tempest-DeleteServersTestJSON-368419735 tempest-DeleteServersTestJSON-368419735-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:31:45.907735 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-166bd648-4a88-4ff9-9117-19a247da0c82 tempest-DeleteServersTestJSON-368419735 tempest-DeleteServersTestJSON-368419735-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:31:45.910325 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-166bd648-4a88-4ff9-9117-19a247da0c82 tempest-DeleteServersTestJSON-368419735 tempest-DeleteServersTestJSON-368419735-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:31:45.910921 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-166bd648-4a88-4ff9-9117-19a247da0c82 tempest-DeleteServersTestJSON-368419735 tempest-DeleteServersTestJSON-368419735-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:31:48.339447 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.virt.hardware [None req-f2b5ef71-65fe-4c2e-bf45-5f34fb59b5f3 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Flavor limits 0:0:0 {{(pid=102149) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 24 16:31:48.340884 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.virt.hardware [None req-f2b5ef71-65fe-4c2e-bf45-5f34fb59b5f3 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Image limits 0:0:0 {{(pid=102149) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 24 16:31:48.343492 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.virt.hardware [None req-f2b5ef71-65fe-4c2e-bf45-5f34fb59b5f3 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Flavor pref 0:0:0 {{(pid=102149) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 24 16:31:48.345037 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.virt.hardware [None req-f2b5ef71-65fe-4c2e-bf45-5f34fb59b5f3 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Image pref 0:0:0 {{(pid=102149) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 24 16:31:48.346879 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.virt.hardware [None req-f2b5ef71-65fe-4c2e-bf45-5f34fb59b5f3 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=102149) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 24 16:31:48.402311 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-f2b5ef71-65fe-4c2e-bf45-5f34fb59b5f3 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:31:48.404533 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-f2b5ef71-65fe-4c2e-bf45-5f34fb59b5f3 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:31:48.410030 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-f2b5ef71-65fe-4c2e-bf45-5f34fb59b5f3 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:31:48.413040 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-f2b5ef71-65fe-4c2e-bf45-5f34fb59b5f3 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:31:48.430352 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-166bd648-4a88-4ff9-9117-19a247da0c82 tempest-DeleteServersTestJSON-368419735 tempest-DeleteServersTestJSON-368419735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81eaf76db05e41feb86cb793787bdeac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '166c04f72691440d883f2508cc22df58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:31:48.448898 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-166bd648-4a88-4ff9-9117-19a247da0c82 tempest-DeleteServersTestJSON-368419735 tempest-DeleteServersTestJSON-368419735-project] 10.222.0.18 "GET /compute/v2.1/servers/618dfcb0-fc23-4985-a7e0-9ec51837519b" status: 200 len: 1314 microversion: 2.1 time: 2.617318 Jun 24 16:31:48.467830 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 19/29] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:31:45 2022] GET /compute/v2.1/servers/618dfcb0-fc23-4985-a7e0-9ec51837519b => generated 1314 bytes in 2637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 16:31:48.548550 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.quota [None req-f2b5ef71-65fe-4c2e-bf45-5f34fb59b5f3 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Getting quotas for project 09584de3a4b14c5a90eb9b1c2149d6fb. Resources: {'ram', 'instances', 'cores'} {{(pid=102149) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jun 24 16:31:48.565274 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.quota [None req-f2b5ef71-65fe-4c2e-bf45-5f34fb59b5f3 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Getting quotas for user f2c286a3f03048689e5ec552bb89c161 and project 09584de3a4b14c5a90eb9b1c2149d6fb. Resources: {'ram', 'instances', 'cores'} {{(pid=102149) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jun 24 16:31:48.601298 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-f2b5ef71-65fe-4c2e-bf45-5f34fb59b5f3 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Going to run 1 instances... {{(pid=102149) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Jun 24 16:31:48.605122 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-f2b5ef71-65fe-4c2e-bf45-5f34fb59b5f3 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] [instance: 4eb74274-8b99-455f-8f03-681fbea6b6e0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='113c9cfb-6cee-4018-9e63-66fae82b3851',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=102149) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1684}} Jun 24 16:31:48.811661 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-f2b5ef71-65fe-4c2e-bf45-5f34fb59b5f3 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 6.691983 Jun 24 16:31:48.814962 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 11/30] 10.222.0.18 () {60 vars in 1146 bytes} [Fri Jun 24 16:31:42 2022] POST /compute/v2.1/servers => generated 383 bytes in 6699 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 24 16:31:48.829943 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-a9ab2427-a4aa-4037-a806-1f28a8a8b7f3 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-457514009", "imageRef": "113c9cfb-6cee-4018-9e63-66fae82b3851", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "de427c78-c07a-4b67-b16a-301f510eb5d6"}], "security_groups": [{"name": "tempest-securitygroup--1220830654"}], "key_name": "tempest-keypair-116280810", "user_data": "}} {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 16:31:49.015832 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [req-e251b136-ffdf-4fc9-8840-2c5f89c055eb req-2292458c-266e-41fe-ba56-c71436753773 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "618dfcb0-fc23-4985-a7e0-9ec51837519b", "tag": "01b6a726-f17e-4aa4-8491-1194120a4053"}]} {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 16:31:49.018621 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 24 16:31:49.018621 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: warnings.warn(msg) Jun 24 16:31:49.046443 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [req-e251b136-ffdf-4fc9-8840-2c5f89c055eb req-2292458c-266e-41fe-ba56-c71436753773 service nova] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:31:49.047187 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [req-e251b136-ffdf-4fc9-8840-2c5f89c055eb req-2292458c-266e-41fe-ba56-c71436753773 service nova] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:31:49.155559 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.compute.server_external_events [req-e251b136-ffdf-4fc9-8840-2c5f89c055eb req-2292458c-266e-41fe-ba56-c71436753773 service nova] Creating event network-changed:01b6a726-f17e-4aa4-8491-1194120a4053 for instance 618dfcb0-fc23-4985-a7e0-9ec51837519b on hv-cinder-84718 Jun 24 16:31:49.156542 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [req-e251b136-ffdf-4fc9-8840-2c5f89c055eb req-2292458c-266e-41fe-ba56-c71436753773 service nova] Acquired lock "compute-rpcapi-router" {{(pid=102148) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:266}} Jun 24 16:31:49.158045 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-431d905d-1fff-42a9-b841-d0ab73c4f6bd None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:31:49.158486 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-431d905d-1fff-42a9-b841-d0ab73c4f6bd None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:31:49.159639 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-431d905d-1fff-42a9-b841-d0ab73c4f6bd None None] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:31:49.160219 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-431d905d-1fff-42a9-b841-d0ab73c4f6bd None None] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:31:49.170912 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.compute.rpcapi [None req-431d905d-1fff-42a9-b841-d0ab73c4f6bd None None] Automatically selected compute RPC version 6.0 from minimum service version 56 Jun 24 16:31:49.172229 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-431d905d-1fff-42a9-b841-d0ab73c4f6bd None None] Releasing lock "compute-rpcapi-router" {{(pid=102148) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:282}} Jun 24 16:31:49.209741 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-431d905d-1fff-42a9-b841-d0ab73c4f6bd None None] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.738870 Jun 24 16:31:49.210852 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 20/31] 10.222.0.18 () {64 vars in 1317 bytes} [Fri Jun 24 16:31:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 16:31:49.224999 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-e051bec9-4eda-4b03-982b-32de10a96db3 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Calling method '>' {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:31:49.225800 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-e051bec9-4eda-4b03-982b-32de10a96db3 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] [instance: 4eb74274-8b99-455f-8f03-681fbea6b6e0] Fetching instance by UUID {{(pid=102148) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:31:49.688385 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-e051bec9-4eda-4b03-982b-32de10a96db3 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c286a3f03048689e5ec552bb89c161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09584de3a4b14c5a90eb9b1c2149d6fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:31:49.716855 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-e051bec9-4eda-4b03-982b-32de10a96db3 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] 10.222.0.18 "GET /compute/v2.1/servers/4eb74274-8b99-455f-8f03-681fbea6b6e0" status: 200 len: 1221 microversion: 2.1 time: 0.503053 Jun 24 16:31:49.717540 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 21/32] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:31:49 2022] GET /compute/v2.1/servers/4eb74274-8b99-455f-8f03-681fbea6b6e0 => generated 1221 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 16:31:49.735341 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-207936d2-73e8-41c0-9426-cc8eb338f9e8 tempest-DeleteServersTestJSON-368419735 tempest-DeleteServersTestJSON-368419735-project] Calling method '>' {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:31:49.744204 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-207936d2-73e8-41c0-9426-cc8eb338f9e8 tempest-DeleteServersTestJSON-368419735 tempest-DeleteServersTestJSON-368419735-project] [instance: 618dfcb0-fc23-4985-a7e0-9ec51837519b] Fetching instance by UUID {{(pid=102148) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:31:49.773270 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-207936d2-73e8-41c0-9426-cc8eb338f9e8 tempest-DeleteServersTestJSON-368419735 tempest-DeleteServersTestJSON-368419735-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:31:49.786144 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-207936d2-73e8-41c0-9426-cc8eb338f9e8 tempest-DeleteServersTestJSON-368419735 tempest-DeleteServersTestJSON-368419735-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:31:49.788226 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-207936d2-73e8-41c0-9426-cc8eb338f9e8 tempest-DeleteServersTestJSON-368419735 tempest-DeleteServersTestJSON-368419735-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:31:49.796706 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-207936d2-73e8-41c0-9426-cc8eb338f9e8 tempest-DeleteServersTestJSON-368419735 tempest-DeleteServersTestJSON-368419735-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:31:49.867041 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.network.neutron [None req-a9ab2427-a4aa-4037-a806-1f28a8a8b7f3 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] validate_networks() for [('de427c78-c07a-4b67-b16a-301f510eb5d6', None, None, None)] {{(pid=102149) validate_networks /opt/stack/nova/nova/network/neutron.py:2367}} Jun 24 16:31:50.837926 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-207936d2-73e8-41c0-9426-cc8eb338f9e8 tempest-DeleteServersTestJSON-368419735 tempest-DeleteServersTestJSON-368419735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81eaf76db05e41feb86cb793787bdeac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '166c04f72691440d883f2508cc22df58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:31:50.859863 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-207936d2-73e8-41c0-9426-cc8eb338f9e8 tempest-DeleteServersTestJSON-368419735 tempest-DeleteServersTestJSON-368419735-project] 10.222.0.18 "GET /compute/v2.1/servers/618dfcb0-fc23-4985-a7e0-9ec51837519b" status: 200 len: 1314 microversion: 2.1 time: 1.141073 Jun 24 16:31:50.879587 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 22/33] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:31:49 2022] GET /compute/v2.1/servers/618dfcb0-fc23-4985-a7e0-9ec51837519b => generated 1314 bytes in 1160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 16:31:50.892729 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-877596ac-b07a-4b6a-a296-6a7a7cc01547 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-690402376", "imageRef": "113c9cfb-6cee-4018-9e63-66fae82b3851", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 16:31:51.089351 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.network.neutron [None req-877596ac-b07a-4b6a-a296-6a7a7cc01547 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] validate_networks() for [('e798456c-6e0e-4eb9-9c41-fac0ea090965', None, None, None)] {{(pid=102148) validate_networks /opt/stack/nova/nova/network/neutron.py:2367}} Jun 24 16:31:52.562370 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.virt.hardware [None req-a9ab2427-a4aa-4037-a806-1f28a8a8b7f3 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Flavor limits 0:0:0 {{(pid=102149) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 24 16:31:52.564066 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.virt.hardware [None req-a9ab2427-a4aa-4037-a806-1f28a8a8b7f3 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Image limits 0:0:0 {{(pid=102149) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 24 16:31:52.564704 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.virt.hardware [None req-a9ab2427-a4aa-4037-a806-1f28a8a8b7f3 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Flavor pref 0:0:0 {{(pid=102149) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 24 16:31:52.565267 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.virt.hardware [None req-a9ab2427-a4aa-4037-a806-1f28a8a8b7f3 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Image pref 0:0:0 {{(pid=102149) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 24 16:31:52.565835 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.virt.hardware [None req-a9ab2427-a4aa-4037-a806-1f28a8a8b7f3 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=102149) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 24 16:31:52.584983 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-a9ab2427-a4aa-4037-a806-1f28a8a8b7f3 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:31:52.618527 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-a9ab2427-a4aa-4037-a806-1f28a8a8b7f3 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.034s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:31:52.621743 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-a9ab2427-a4aa-4037-a806-1f28a8a8b7f3 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:31:52.629643 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-a9ab2427-a4aa-4037-a806-1f28a8a8b7f3 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:31:52.673339 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.quota [None req-a9ab2427-a4aa-4037-a806-1f28a8a8b7f3 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Getting quotas for project 065254ebe67545639644fcbc6bd9fc31. Resources: {'ram', 'instances', 'cores'} {{(pid=102149) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jun 24 16:31:52.707638 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.quota [None req-a9ab2427-a4aa-4037-a806-1f28a8a8b7f3 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Getting quotas for user 7489b29cb3ef47d78dfd55794f338b27 and project 065254ebe67545639644fcbc6bd9fc31. Resources: {'ram', 'instances', 'cores'} {{(pid=102149) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jun 24 16:31:52.741268 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-a9ab2427-a4aa-4037-a806-1f28a8a8b7f3 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Going to run 1 instances... {{(pid=102149) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Jun 24 16:31:52.747177 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-a9ab2427-a4aa-4037-a806-1f28a8a8b7f3 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] [instance: 30b3ffec-7110-4b4d-9482-2451914c166f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='113c9cfb-6cee-4018-9e63-66fae82b3851',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=102149) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1684}} Jun 24 16:31:52.880053 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-a9ab2427-a4aa-4037-a806-1f28a8a8b7f3 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 4.058594 Jun 24 16:31:52.883536 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 12/34] 10.222.0.18 () {62 vars in 1187 bytes} [Fri Jun 24 16:31:48 2022] POST /compute/v2.1/servers => generated 402 bytes in 4068 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jun 24 16:31:52.906306 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-ce9b7f9d-3e6f-4155-8ee5-3cdf54f824bd tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-424959999", "imageRef": "113c9cfb-6cee-4018-9e63-66fae82b3851", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "45be4882-d29a-4ee7-b3ed-ba8729666ff7"}], "security_groups": [{"name": "tempest-securitygroup--976734126"}], "key_name": "tempest-keypair-1345199728", "user_data": "}} {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 16:31:53.474164 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.network.neutron [None req-ce9b7f9d-3e6f-4155-8ee5-3cdf54f824bd tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] validate_networks() for [('45be4882-d29a-4ee7-b3ed-ba8729666ff7', None, None, None)] {{(pid=102149) validate_networks /opt/stack/nova/nova/network/neutron.py:2367}} Jun 24 16:31:57.089537 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.virt.hardware [None req-877596ac-b07a-4b6a-a296-6a7a7cc01547 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Flavor limits 0:0:0 {{(pid=102148) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 24 16:31:57.090475 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.virt.hardware [None req-877596ac-b07a-4b6a-a296-6a7a7cc01547 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Image limits 0:0:0 {{(pid=102148) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 24 16:31:57.091836 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.virt.hardware [None req-877596ac-b07a-4b6a-a296-6a7a7cc01547 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Flavor pref 0:0:0 {{(pid=102148) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 24 16:31:57.092495 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.virt.hardware [None req-877596ac-b07a-4b6a-a296-6a7a7cc01547 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Image pref 0:0:0 {{(pid=102148) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 24 16:31:57.093155 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.virt.hardware [None req-877596ac-b07a-4b6a-a296-6a7a7cc01547 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=102148) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 24 16:31:57.137518 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-877596ac-b07a-4b6a-a296-6a7a7cc01547 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:31:57.143445 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-877596ac-b07a-4b6a-a296-6a7a7cc01547 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:31:57.144727 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-877596ac-b07a-4b6a-a296-6a7a7cc01547 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:31:57.146569 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-877596ac-b07a-4b6a-a296-6a7a7cc01547 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:31:57.224170 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.quota [None req-877596ac-b07a-4b6a-a296-6a7a7cc01547 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Getting quotas for project 09584de3a4b14c5a90eb9b1c2149d6fb. Resources: {'ram', 'instances', 'cores'} {{(pid=102148) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jun 24 16:31:57.234195 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.quota [None req-877596ac-b07a-4b6a-a296-6a7a7cc01547 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Getting quotas for user f2c286a3f03048689e5ec552bb89c161 and project 09584de3a4b14c5a90eb9b1c2149d6fb. Resources: {'ram', 'instances', 'cores'} {{(pid=102148) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jun 24 16:31:57.261351 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-877596ac-b07a-4b6a-a296-6a7a7cc01547 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Going to run 1 instances... {{(pid=102148) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Jun 24 16:31:57.274420 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-877596ac-b07a-4b6a-a296-6a7a7cc01547 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] [instance: 1c690e22-ec9b-423d-9f32-e01ffb3fa4b1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='113c9cfb-6cee-4018-9e63-66fae82b3851',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=102148) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1684}} Jun 24 16:31:57.419622 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-877596ac-b07a-4b6a-a296-6a7a7cc01547 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 6.538082 Jun 24 16:31:57.421200 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 23/35] 10.222.0.18 () {60 vars in 1146 bytes} [Fri Jun 24 16:31:50 2022] POST /compute/v2.1/servers => generated 383 bytes in 6541 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 24 16:31:57.465098 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-4353eb47-4e26-4515-8186-0dfa06913665 tempest-DeleteServersTestJSON-368419735 tempest-DeleteServersTestJSON-368419735-project] Calling method '>' {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:31:57.471700 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-4353eb47-4e26-4515-8186-0dfa06913665 tempest-DeleteServersTestJSON-368419735 tempest-DeleteServersTestJSON-368419735-project] [instance: 618dfcb0-fc23-4985-a7e0-9ec51837519b] Fetching instance by UUID {{(pid=102148) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:31:57.523849 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-4353eb47-4e26-4515-8186-0dfa06913665 tempest-DeleteServersTestJSON-368419735 tempest-DeleteServersTestJSON-368419735-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:31:57.530495 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-4353eb47-4e26-4515-8186-0dfa06913665 tempest-DeleteServersTestJSON-368419735 tempest-DeleteServersTestJSON-368419735-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:31:57.535915 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-4353eb47-4e26-4515-8186-0dfa06913665 tempest-DeleteServersTestJSON-368419735 tempest-DeleteServersTestJSON-368419735-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:31:57.543691 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-4353eb47-4e26-4515-8186-0dfa06913665 tempest-DeleteServersTestJSON-368419735 tempest-DeleteServersTestJSON-368419735-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:31:58.332247 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.virt.hardware [None req-ce9b7f9d-3e6f-4155-8ee5-3cdf54f824bd tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Flavor limits 0:0:0 {{(pid=102149) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 24 16:31:58.333908 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.virt.hardware [None req-ce9b7f9d-3e6f-4155-8ee5-3cdf54f824bd tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Image limits 0:0:0 {{(pid=102149) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 24 16:31:58.334898 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.virt.hardware [None req-ce9b7f9d-3e6f-4155-8ee5-3cdf54f824bd tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Flavor pref 0:0:0 {{(pid=102149) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 24 16:31:58.335927 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.virt.hardware [None req-ce9b7f9d-3e6f-4155-8ee5-3cdf54f824bd tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Image pref 0:0:0 {{(pid=102149) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 24 16:31:58.336611 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.virt.hardware [None req-ce9b7f9d-3e6f-4155-8ee5-3cdf54f824bd tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=102149) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 24 16:31:58.362985 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-ce9b7f9d-3e6f-4155-8ee5-3cdf54f824bd tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:31:58.363384 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-ce9b7f9d-3e6f-4155-8ee5-3cdf54f824bd tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:31:58.364280 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-ce9b7f9d-3e6f-4155-8ee5-3cdf54f824bd tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:31:58.364737 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-ce9b7f9d-3e6f-4155-8ee5-3cdf54f824bd tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:31:58.464993 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.quota [None req-ce9b7f9d-3e6f-4155-8ee5-3cdf54f824bd tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Getting quotas for project 606ba814a2d8408ab0856d539ca79b4f. Resources: {'ram', 'instances', 'cores'} {{(pid=102149) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jun 24 16:31:58.489801 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.quota [None req-ce9b7f9d-3e6f-4155-8ee5-3cdf54f824bd tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Getting quotas for user 499faf87cf8c41ae823b2566e4c2d8ce and project 606ba814a2d8408ab0856d539ca79b4f. Resources: {'ram', 'instances', 'cores'} {{(pid=102149) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jun 24 16:31:58.516786 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-ce9b7f9d-3e6f-4155-8ee5-3cdf54f824bd tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Going to run 1 instances... {{(pid=102149) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Jun 24 16:31:58.523683 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-ce9b7f9d-3e6f-4155-8ee5-3cdf54f824bd tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] [instance: 2fa4f019-3cbd-4b41-a0fc-6513f46474c0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='113c9cfb-6cee-4018-9e63-66fae82b3851',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=102149) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1684}} Jun 24 16:31:58.712783 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-ce9b7f9d-3e6f-4155-8ee5-3cdf54f824bd tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 5.823336 Jun 24 16:31:58.714520 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 13/36] 10.222.0.18 () {60 vars in 1146 bytes} [Fri Jun 24 16:31:52 2022] POST /compute/v2.1/servers => generated 401 bytes in 5830 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 24 16:31:58.729504 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-e09baefa-669b-4704-b8c2-6f90f27b269f tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Calling method '>' {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:31:58.730593 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-e09baefa-669b-4704-b8c2-6f90f27b269f tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] [instance: 30b3ffec-7110-4b4d-9482-2451914c166f] Fetching instance by UUID {{(pid=102149) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:31:58.745840 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-e09baefa-669b-4704-b8c2-6f90f27b269f tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:31:58.746621 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-e09baefa-669b-4704-b8c2-6f90f27b269f tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:31:58.747733 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-e09baefa-669b-4704-b8c2-6f90f27b269f tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:31:58.749939 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-e09baefa-669b-4704-b8c2-6f90f27b269f tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:31:59.284105 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-e09baefa-669b-4704-b8c2-6f90f27b269f tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7489b29cb3ef47d78dfd55794f338b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065254ebe67545639644fcbc6bd9fc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:31:59.366145 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-e09baefa-669b-4704-b8c2-6f90f27b269f tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7489b29cb3ef47d78dfd55794f338b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065254ebe67545639644fcbc6bd9fc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:31:59.372801 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-e09baefa-669b-4704-b8c2-6f90f27b269f tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7489b29cb3ef47d78dfd55794f338b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065254ebe67545639644fcbc6bd9fc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:31:59.382407 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-e09baefa-669b-4704-b8c2-6f90f27b269f tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] 10.222.0.18 "GET /compute/v2.1/servers/30b3ffec-7110-4b4d-9482-2451914c166f" status: 200 len: 1338 microversion: 2.20 time: 0.657958 Jun 24 16:31:59.398725 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 14/37] 10.222.0.18 () {60 vars in 1276 bytes} [Fri Jun 24 16:31:58 2022] GET /compute/v2.1/servers/30b3ffec-7110-4b4d-9482-2451914c166f => generated 1338 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 16:31:59.415798 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-f050db8d-c33f-4ebc-b1a4-b9a93562ebb8 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Calling method '>' {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:31:59.423506 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-f050db8d-c33f-4ebc-b1a4-b9a93562ebb8 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] [instance: 1c690e22-ec9b-423d-9f32-e01ffb3fa4b1] Fetching instance by UUID {{(pid=102149) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:31:59.477640 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-f050db8d-c33f-4ebc-b1a4-b9a93562ebb8 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:31:59.483009 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-f050db8d-c33f-4ebc-b1a4-b9a93562ebb8 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:31:59.485442 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-f050db8d-c33f-4ebc-b1a4-b9a93562ebb8 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:31:59.496355 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-f050db8d-c33f-4ebc-b1a4-b9a93562ebb8 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:31:59.579840 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-4353eb47-4e26-4515-8186-0dfa06913665 tempest-DeleteServersTestJSON-368419735 tempest-DeleteServersTestJSON-368419735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81eaf76db05e41feb86cb793787bdeac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '166c04f72691440d883f2508cc22df58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:31:59.610458 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-4353eb47-4e26-4515-8186-0dfa06913665 tempest-DeleteServersTestJSON-368419735 tempest-DeleteServersTestJSON-368419735-project] 10.222.0.18 "GET /compute/v2.1/servers/618dfcb0-fc23-4985-a7e0-9ec51837519b" status: 200 len: 1314 microversion: 2.1 time: 2.185367 Jun 24 16:31:59.612668 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 24/38] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:31:57 2022] GET /compute/v2.1/servers/618dfcb0-fc23-4985-a7e0-9ec51837519b => generated 1314 bytes in 2191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 16:31:59.618476 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-40fcde15-0209-4e11-9d4d-25abfc492266 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Calling method '>' {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:31:59.619205 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-40fcde15-0209-4e11-9d4d-25abfc492266 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] [instance: 2fa4f019-3cbd-4b41-a0fc-6513f46474c0] Fetching instance by UUID {{(pid=102148) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:32:01.253565 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-40fcde15-0209-4e11-9d4d-25abfc492266 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '499faf87cf8c41ae823b2566e4c2d8ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606ba814a2d8408ab0856d539ca79b4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:32:01.284148 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-40fcde15-0209-4e11-9d4d-25abfc492266 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] 10.222.0.18 "GET /compute/v2.1/servers/2fa4f019-3cbd-4b41-a0fc-6513f46474c0" status: 200 len: 1241 microversion: 2.1 time: 1.668598 Jun 24 16:32:01.286266 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 25/39] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:31:59 2022] GET /compute/v2.1/servers/2fa4f019-3cbd-4b41-a0fc-6513f46474c0 => generated 1241 bytes in 1673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 16:32:01.517287 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [req-891c6ca2-4d65-4d71-a953-c71270799fad req-ace9731b-b223-4b16-8dcb-5bb5d501894d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4eb74274-8b99-455f-8f03-681fbea6b6e0", "tag": "11484e4d-aa90-40ce-8ec1-7ff4b72f6d02"}]} {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 16:32:01.527712 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 24 16:32:01.527712 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: warnings.warn(msg) Jun 24 16:32:01.541895 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-f050db8d-c33f-4ebc-b1a4-b9a93562ebb8 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c286a3f03048689e5ec552bb89c161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09584de3a4b14c5a90eb9b1c2149d6fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:32:01.608136 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [req-891c6ca2-4d65-4d71-a953-c71270799fad req-ace9731b-b223-4b16-8dcb-5bb5d501894d service nova] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:32:01.608728 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [req-891c6ca2-4d65-4d71-a953-c71270799fad req-ace9731b-b223-4b16-8dcb-5bb5d501894d service nova] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:32:01.612166 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-f050db8d-c33f-4ebc-b1a4-b9a93562ebb8 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] 10.222.0.18 "GET /compute/v2.1/servers/1c690e22-ec9b-423d-9f32-e01ffb3fa4b1" status: 200 len: 1273 microversion: 2.1 time: 2.217651 Jun 24 16:32:01.619878 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 15/40] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:31:59 2022] GET /compute/v2.1/servers/1c690e22-ec9b-423d-9f32-e01ffb3fa4b1 => generated 1273 bytes in 2230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 16:32:01.649124 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-52840e05-1ae0-47b0-819f-0908168fa606 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Calling method '>' {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:32:01.656139 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-52840e05-1ae0-47b0-819f-0908168fa606 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] [instance: 30b3ffec-7110-4b4d-9482-2451914c166f] Fetching instance by UUID {{(pid=102149) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:32:01.686261 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-52840e05-1ae0-47b0-819f-0908168fa606 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:32:01.687388 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-52840e05-1ae0-47b0-819f-0908168fa606 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:32:01.689437 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-52840e05-1ae0-47b0-819f-0908168fa606 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:32:01.689856 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.compute.server_external_events [req-891c6ca2-4d65-4d71-a953-c71270799fad req-ace9731b-b223-4b16-8dcb-5bb5d501894d service nova] Creating event network-changed:11484e4d-aa90-40ce-8ec1-7ff4b72f6d02 for instance 4eb74274-8b99-455f-8f03-681fbea6b6e0 on hv-cinder-84718 Jun 24 16:32:01.690990 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-52840e05-1ae0-47b0-819f-0908168fa606 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:32:01.733282 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [req-891c6ca2-4d65-4d71-a953-c71270799fad req-ace9731b-b223-4b16-8dcb-5bb5d501894d service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.436610 Jun 24 16:32:01.737112 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 26/41] 10.222.0.18 () {64 vars in 1317 bytes} [Fri Jun 24 16:32:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 16:32:01.767988 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-41ba2651-c5b8-454d-b035-5edd946b345e tempest-DeleteServersTestJSON-368419735 tempest-DeleteServersTestJSON-368419735-project] Calling method '>' {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:32:01.772109 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-41ba2651-c5b8-454d-b035-5edd946b345e tempest-DeleteServersTestJSON-368419735 tempest-DeleteServersTestJSON-368419735-project] [instance: 618dfcb0-fc23-4985-a7e0-9ec51837519b] Fetching instance by UUID {{(pid=102148) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:32:01.800158 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-41ba2651-c5b8-454d-b035-5edd946b345e tempest-DeleteServersTestJSON-368419735 tempest-DeleteServersTestJSON-368419735-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:32:01.801700 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-41ba2651-c5b8-454d-b035-5edd946b345e tempest-DeleteServersTestJSON-368419735 tempest-DeleteServersTestJSON-368419735-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:32:01.819397 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-41ba2651-c5b8-454d-b035-5edd946b345e tempest-DeleteServersTestJSON-368419735 tempest-DeleteServersTestJSON-368419735-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:32:01.820021 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-41ba2651-c5b8-454d-b035-5edd946b345e tempest-DeleteServersTestJSON-368419735 tempest-DeleteServersTestJSON-368419735-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:32:02.618431 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-52840e05-1ae0-47b0-819f-0908168fa606 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7489b29cb3ef47d78dfd55794f338b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065254ebe67545639644fcbc6bd9fc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:32:02.663346 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-52840e05-1ae0-47b0-819f-0908168fa606 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7489b29cb3ef47d78dfd55794f338b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065254ebe67545639644fcbc6bd9fc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:32:02.694784 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-52840e05-1ae0-47b0-819f-0908168fa606 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7489b29cb3ef47d78dfd55794f338b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065254ebe67545639644fcbc6bd9fc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:32:02.697881 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-52840e05-1ae0-47b0-819f-0908168fa606 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] 10.222.0.18 "GET /compute/v2.1/servers/30b3ffec-7110-4b4d-9482-2451914c166f" status: 200 len: 1338 microversion: 2.20 time: 1.059367 Jun 24 16:32:02.716031 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 16/42] 10.222.0.18 () {60 vars in 1276 bytes} [Fri Jun 24 16:32:01 2022] GET /compute/v2.1/servers/30b3ffec-7110-4b4d-9482-2451914c166f => generated 1338 bytes in 1097 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 16:32:02.737496 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-a5a2fff4-a52a-4b3b-b08c-300752d3a2f0 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Calling method '>' {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:32:02.743202 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-a5a2fff4-a52a-4b3b-b08c-300752d3a2f0 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] [instance: 2fa4f019-3cbd-4b41-a0fc-6513f46474c0] Fetching instance by UUID {{(pid=102149) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:32:02.774592 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-a5a2fff4-a52a-4b3b-b08c-300752d3a2f0 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:32:02.777214 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-a5a2fff4-a52a-4b3b-b08c-300752d3a2f0 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:32:02.781823 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-a5a2fff4-a52a-4b3b-b08c-300752d3a2f0 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:32:02.785315 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-a5a2fff4-a52a-4b3b-b08c-300752d3a2f0 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:32:03.657386 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-a5a2fff4-a52a-4b3b-b08c-300752d3a2f0 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '499faf87cf8c41ae823b2566e4c2d8ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606ba814a2d8408ab0856d539ca79b4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:32:03.710188 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-a5a2fff4-a52a-4b3b-b08c-300752d3a2f0 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] 10.222.0.18 "GET /compute/v2.1/servers/2fa4f019-3cbd-4b41-a0fc-6513f46474c0" status: 200 len: 1311 microversion: 2.1 time: 0.967039 Jun 24 16:32:03.713504 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 17/43] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:32:02 2022] GET /compute/v2.1/servers/2fa4f019-3cbd-4b41-a0fc-6513f46474c0 => generated 1311 bytes in 996 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 16:32:03.733059 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-1a295df6-561a-4a6e-90c7-47bdb84ba75d tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Calling method '>' {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:32:03.750220 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-1a295df6-561a-4a6e-90c7-47bdb84ba75d tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] [instance: 1c690e22-ec9b-423d-9f32-e01ffb3fa4b1] Fetching instance by UUID {{(pid=102149) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:32:03.800298 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-1a295df6-561a-4a6e-90c7-47bdb84ba75d tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:32:03.802627 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-1a295df6-561a-4a6e-90c7-47bdb84ba75d tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:32:03.806510 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-1a295df6-561a-4a6e-90c7-47bdb84ba75d tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:32:03.808942 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-1a295df6-561a-4a6e-90c7-47bdb84ba75d tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:32:04.467597 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-41ba2651-c5b8-454d-b035-5edd946b345e tempest-DeleteServersTestJSON-368419735 tempest-DeleteServersTestJSON-368419735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81eaf76db05e41feb86cb793787bdeac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '166c04f72691440d883f2508cc22df58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:32:04.494097 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-41ba2651-c5b8-454d-b035-5edd946b345e tempest-DeleteServersTestJSON-368419735 tempest-DeleteServersTestJSON-368419735-project] 10.222.0.18 "GET /compute/v2.1/servers/618dfcb0-fc23-4985-a7e0-9ec51837519b" status: 200 len: 1314 microversion: 2.1 time: 2.741691 Jun 24 16:32:04.495139 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 27/44] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:32:01 2022] GET /compute/v2.1/servers/618dfcb0-fc23-4985-a7e0-9ec51837519b => generated 1314 bytes in 2757 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 16:32:04.602614 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-1a295df6-561a-4a6e-90c7-47bdb84ba75d tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c286a3f03048689e5ec552bb89c161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09584de3a4b14c5a90eb9b1c2149d6fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:32:04.633308 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-1a295df6-561a-4a6e-90c7-47bdb84ba75d tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] 10.222.0.18 "GET /compute/v2.1/servers/1c690e22-ec9b-423d-9f32-e01ffb3fa4b1" status: 200 len: 1279 microversion: 2.1 time: 0.915711 Jun 24 16:32:04.649998 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 18/45] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:32:03 2022] GET /compute/v2.1/servers/1c690e22-ec9b-423d-9f32-e01ffb3fa4b1 => generated 1279 bytes in 936 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 16:32:04.679180 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-45f71c76-83bf-4c31-b034-4136d5e24f92 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Calling method '>' {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:32:04.680355 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-45f71c76-83bf-4c31-b034-4136d5e24f92 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] [instance: 30b3ffec-7110-4b4d-9482-2451914c166f] Fetching instance by UUID {{(pid=102149) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:32:04.732100 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-45f71c76-83bf-4c31-b034-4136d5e24f92 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:32:04.732562 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-45f71c76-83bf-4c31-b034-4136d5e24f92 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:32:04.733363 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-45f71c76-83bf-4c31-b034-4136d5e24f92 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:32:04.747208 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-45f71c76-83bf-4c31-b034-4136d5e24f92 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:32:04.987634 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [req-8d31b5d1-1b05-4672-87e0-a4986ace9644 req-3bfce6dc-d2a9-4f0e-9e01-fab999b69edf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "618dfcb0-fc23-4985-a7e0-9ec51837519b", "name": "network-vif-plugged", "status": "completed", "tag": "01b6a726-f17e-4aa4-8491-1194120a4053"}]} {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 16:32:04.992990 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 24 16:32:04.992990 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: warnings.warn(msg) Jun 24 16:32:05.012577 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [req-8d31b5d1-1b05-4672-87e0-a4986ace9644 req-3bfce6dc-d2a9-4f0e-9e01-fab999b69edf service nova] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:32:05.013713 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [req-8d31b5d1-1b05-4672-87e0-a4986ace9644 req-3bfce6dc-d2a9-4f0e-9e01-fab999b69edf service nova] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:32:05.056739 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.compute.server_external_events [req-8d31b5d1-1b05-4672-87e0-a4986ace9644 req-3bfce6dc-d2a9-4f0e-9e01-fab999b69edf service nova] Creating event network-vif-plugged:01b6a726-f17e-4aa4-8491-1194120a4053 for instance 618dfcb0-fc23-4985-a7e0-9ec51837519b on hv-cinder-84718 Jun 24 16:32:05.065736 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [req-8d31b5d1-1b05-4672-87e0-a4986ace9644 req-3bfce6dc-d2a9-4f0e-9e01-fab999b69edf service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.567604 Jun 24 16:32:05.067405 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 28/46] 10.222.0.18 () {64 vars in 1317 bytes} [Fri Jun 24 16:32:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 16:32:05.091843 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-ae45f1e4-a798-4514-8780-31d21a492415 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Calling method '>' {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:32:05.095409 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-ae45f1e4-a798-4514-8780-31d21a492415 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] [instance: 2fa4f019-3cbd-4b41-a0fc-6513f46474c0] Fetching instance by UUID {{(pid=102148) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:32:05.129982 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-ae45f1e4-a798-4514-8780-31d21a492415 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:32:05.134071 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-ae45f1e4-a798-4514-8780-31d21a492415 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:32:05.136224 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-ae45f1e4-a798-4514-8780-31d21a492415 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:32:05.139455 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-ae45f1e4-a798-4514-8780-31d21a492415 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:32:05.533474 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-ae45f1e4-a798-4514-8780-31d21a492415 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '499faf87cf8c41ae823b2566e4c2d8ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606ba814a2d8408ab0856d539ca79b4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:32:05.551143 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-ae45f1e4-a798-4514-8780-31d21a492415 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] 10.222.0.18 "GET /compute/v2.1/servers/2fa4f019-3cbd-4b41-a0fc-6513f46474c0" status: 200 len: 1299 microversion: 2.1 time: 0.479841 Jun 24 16:32:05.570015 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 29/47] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:32:05 2022] GET /compute/v2.1/servers/2fa4f019-3cbd-4b41-a0fc-6513f46474c0 => generated 1299 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 16:32:05.575755 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-bb19c8c0-dbda-43d0-a1a2-89510f3b6f54 tempest-DeleteServersTestJSON-368419735 tempest-DeleteServersTestJSON-368419735-project] Calling method '>' {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:32:05.576714 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-bb19c8c0-dbda-43d0-a1a2-89510f3b6f54 tempest-DeleteServersTestJSON-368419735 tempest-DeleteServersTestJSON-368419735-project] [instance: 618dfcb0-fc23-4985-a7e0-9ec51837519b] Fetching instance by UUID {{(pid=102148) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:32:05.586014 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-bb19c8c0-dbda-43d0-a1a2-89510f3b6f54 tempest-DeleteServersTestJSON-368419735 tempest-DeleteServersTestJSON-368419735-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:32:05.586497 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-bb19c8c0-dbda-43d0-a1a2-89510f3b6f54 tempest-DeleteServersTestJSON-368419735 tempest-DeleteServersTestJSON-368419735-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:32:05.587412 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-bb19c8c0-dbda-43d0-a1a2-89510f3b6f54 tempest-DeleteServersTestJSON-368419735 tempest-DeleteServersTestJSON-368419735-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:32:05.587859 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-bb19c8c0-dbda-43d0-a1a2-89510f3b6f54 tempest-DeleteServersTestJSON-368419735 tempest-DeleteServersTestJSON-368419735-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:32:06.221249 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-45f71c76-83bf-4c31-b034-4136d5e24f92 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7489b29cb3ef47d78dfd55794f338b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065254ebe67545639644fcbc6bd9fc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:32:06.260359 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-45f71c76-83bf-4c31-b034-4136d5e24f92 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7489b29cb3ef47d78dfd55794f338b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065254ebe67545639644fcbc6bd9fc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:32:06.274550 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-45f71c76-83bf-4c31-b034-4136d5e24f92 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7489b29cb3ef47d78dfd55794f338b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065254ebe67545639644fcbc6bd9fc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:32:06.279261 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-45f71c76-83bf-4c31-b034-4136d5e24f92 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] 10.222.0.18 "GET /compute/v2.1/servers/30b3ffec-7110-4b4d-9482-2451914c166f" status: 200 len: 1406 microversion: 2.20 time: 1.624872 Jun 24 16:32:06.280210 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 19/48] 10.222.0.18 () {60 vars in 1276 bytes} [Fri Jun 24 16:32:04 2022] GET /compute/v2.1/servers/30b3ffec-7110-4b4d-9482-2451914c166f => generated 1406 bytes in 1630 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 16:32:06.308786 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-c19ee44a-2587-4f70-8fde-0f5f507157b4 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Calling method '>' {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:32:06.312222 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-c19ee44a-2587-4f70-8fde-0f5f507157b4 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] [instance: 1c690e22-ec9b-423d-9f32-e01ffb3fa4b1] Fetching instance by UUID {{(pid=102149) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:32:06.352710 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-c19ee44a-2587-4f70-8fde-0f5f507157b4 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:32:06.356941 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-c19ee44a-2587-4f70-8fde-0f5f507157b4 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:32:06.358846 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-c19ee44a-2587-4f70-8fde-0f5f507157b4 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:32:06.360779 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-c19ee44a-2587-4f70-8fde-0f5f507157b4 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:32:07.171884 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-bb19c8c0-dbda-43d0-a1a2-89510f3b6f54 tempest-DeleteServersTestJSON-368419735 tempest-DeleteServersTestJSON-368419735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81eaf76db05e41feb86cb793787bdeac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '166c04f72691440d883f2508cc22df58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:32:07.199564 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-bb19c8c0-dbda-43d0-a1a2-89510f3b6f54 tempest-DeleteServersTestJSON-368419735 tempest-DeleteServersTestJSON-368419735-project] 10.222.0.18 "GET /compute/v2.1/servers/618dfcb0-fc23-4985-a7e0-9ec51837519b" status: 200 len: 1314 microversion: 2.1 time: 1.639061 Jun 24 16:32:07.200643 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 30/49] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:32:05 2022] GET /compute/v2.1/servers/618dfcb0-fc23-4985-a7e0-9ec51837519b => generated 1314 bytes in 1641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 16:32:07.221256 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-1140a6db-963c-474b-8593-f5950aa90e6a tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Calling method '>' {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:32:07.222380 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-1140a6db-963c-474b-8593-f5950aa90e6a tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] [instance: 2fa4f019-3cbd-4b41-a0fc-6513f46474c0] Fetching instance by UUID {{(pid=102148) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:32:07.253489 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-1140a6db-963c-474b-8593-f5950aa90e6a tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:32:07.258550 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-1140a6db-963c-474b-8593-f5950aa90e6a tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:32:07.260933 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-1140a6db-963c-474b-8593-f5950aa90e6a tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:32:07.261932 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-1140a6db-963c-474b-8593-f5950aa90e6a tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:32:08.693567 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-c19ee44a-2587-4f70-8fde-0f5f507157b4 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c286a3f03048689e5ec552bb89c161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09584de3a4b14c5a90eb9b1c2149d6fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:32:08.732936 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-c19ee44a-2587-4f70-8fde-0f5f507157b4 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] 10.222.0.18 "GET /compute/v2.1/servers/1c690e22-ec9b-423d-9f32-e01ffb3fa4b1" status: 200 len: 1321 microversion: 2.1 time: 2.450906 Jun 24 16:32:08.743684 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 20/50] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:32:06 2022] GET /compute/v2.1/servers/1c690e22-ec9b-423d-9f32-e01ffb3fa4b1 => generated 1321 bytes in 2454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 16:32:08.764792 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-68926c0c-bc98-4f3f-9961-317b2035036e tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Calling method '>' {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:32:08.765919 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-68926c0c-bc98-4f3f-9961-317b2035036e tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] [instance: 30b3ffec-7110-4b4d-9482-2451914c166f] Fetching instance by UUID {{(pid=102149) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:32:08.791103 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-68926c0c-bc98-4f3f-9961-317b2035036e tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:32:08.794484 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-68926c0c-bc98-4f3f-9961-317b2035036e tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:32:08.796132 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-68926c0c-bc98-4f3f-9961-317b2035036e tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:32:08.798713 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-68926c0c-bc98-4f3f-9961-317b2035036e tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:32:09.357135 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-1140a6db-963c-474b-8593-f5950aa90e6a tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '499faf87cf8c41ae823b2566e4c2d8ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606ba814a2d8408ab0856d539ca79b4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:32:09.388475 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-1140a6db-963c-474b-8593-f5950aa90e6a tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] 10.222.0.18 "GET /compute/v2.1/servers/2fa4f019-3cbd-4b41-a0fc-6513f46474c0" status: 200 len: 1366 microversion: 2.1 time: 2.185961 Jun 24 16:32:09.397084 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 31/51] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:32:07 2022] GET /compute/v2.1/servers/2fa4f019-3cbd-4b41-a0fc-6513f46474c0 => generated 1366 bytes in 2191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 16:32:09.420448 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-5e6b36b6-c42f-47d7-a434-1c79a2185b1d tempest-DeleteServersTestJSON-368419735 tempest-DeleteServersTestJSON-368419735-project] Calling method '>' {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:32:09.421555 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-5e6b36b6-c42f-47d7-a434-1c79a2185b1d tempest-DeleteServersTestJSON-368419735 tempest-DeleteServersTestJSON-368419735-project] [instance: 618dfcb0-fc23-4985-a7e0-9ec51837519b] Fetching instance by UUID {{(pid=102148) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:32:09.497860 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-5e6b36b6-c42f-47d7-a434-1c79a2185b1d tempest-DeleteServersTestJSON-368419735 tempest-DeleteServersTestJSON-368419735-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:32:09.500786 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-5e6b36b6-c42f-47d7-a434-1c79a2185b1d tempest-DeleteServersTestJSON-368419735 tempest-DeleteServersTestJSON-368419735-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:32:09.504720 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-5e6b36b6-c42f-47d7-a434-1c79a2185b1d tempest-DeleteServersTestJSON-368419735 tempest-DeleteServersTestJSON-368419735-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:32:09.505565 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-5e6b36b6-c42f-47d7-a434-1c79a2185b1d tempest-DeleteServersTestJSON-368419735 tempest-DeleteServersTestJSON-368419735-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:32:10.651607 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-68926c0c-bc98-4f3f-9961-317b2035036e tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7489b29cb3ef47d78dfd55794f338b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065254ebe67545639644fcbc6bd9fc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:32:10.687357 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-68926c0c-bc98-4f3f-9961-317b2035036e tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7489b29cb3ef47d78dfd55794f338b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065254ebe67545639644fcbc6bd9fc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:32:10.695666 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-68926c0c-bc98-4f3f-9961-317b2035036e tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7489b29cb3ef47d78dfd55794f338b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065254ebe67545639644fcbc6bd9fc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:32:10.699407 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-68926c0c-bc98-4f3f-9961-317b2035036e tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] 10.222.0.18 "GET /compute/v2.1/servers/30b3ffec-7110-4b4d-9482-2451914c166f" status: 200 len: 1406 microversion: 2.20 time: 1.960636 Jun 24 16:32:10.702830 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 21/52] 10.222.0.18 () {60 vars in 1276 bytes} [Fri Jun 24 16:32:08 2022] GET /compute/v2.1/servers/30b3ffec-7110-4b4d-9482-2451914c166f => generated 1406 bytes in 1967 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 16:32:10.720798 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [req-22be0dd3-1bc9-4bde-a129-f1fbdb82b258 req-cf20beb3-7dea-4f52-93f2-c0ee0c282053 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "30b3ffec-7110-4b4d-9482-2451914c166f", "tag": "78a4e31b-a598-4436-bdeb-0904cefd7b6e"}]} {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 16:32:10.730099 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-5e6b36b6-c42f-47d7-a434-1c79a2185b1d tempest-DeleteServersTestJSON-368419735 tempest-DeleteServersTestJSON-368419735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81eaf76db05e41feb86cb793787bdeac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '166c04f72691440d883f2508cc22df58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:32:10.736393 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 24 16:32:10.736393 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: warnings.warn(msg) Jun 24 16:32:10.749184 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-5e6b36b6-c42f-47d7-a434-1c79a2185b1d tempest-DeleteServersTestJSON-368419735 tempest-DeleteServersTestJSON-368419735-project] 10.222.0.18 "GET /compute/v2.1/servers/618dfcb0-fc23-4985-a7e0-9ec51837519b" status: 200 len: 1314 microversion: 2.1 time: 1.350472 Jun 24 16:32:10.749772 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 32/53] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:32:09 2022] GET /compute/v2.1/servers/618dfcb0-fc23-4985-a7e0-9ec51837519b => generated 1314 bytes in 1352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 16:32:10.755864 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-282e519b-5591-44ea-9f2c-dbca531f42bf tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Calling method '>' {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:32:10.756509 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-282e519b-5591-44ea-9f2c-dbca531f42bf tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] [instance: 1c690e22-ec9b-423d-9f32-e01ffb3fa4b1] Fetching instance by UUID {{(pid=102148) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:32:10.775362 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [req-22be0dd3-1bc9-4bde-a129-f1fbdb82b258 req-cf20beb3-7dea-4f52-93f2-c0ee0c282053 service nova] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:32:10.775362 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [req-22be0dd3-1bc9-4bde-a129-f1fbdb82b258 req-cf20beb3-7dea-4f52-93f2-c0ee0c282053 service nova] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:32:10.794055 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.compute.server_external_events [req-22be0dd3-1bc9-4bde-a129-f1fbdb82b258 req-cf20beb3-7dea-4f52-93f2-c0ee0c282053 service nova] Creating event network-changed:78a4e31b-a598-4436-bdeb-0904cefd7b6e for instance 30b3ffec-7110-4b4d-9482-2451914c166f on hv-cinder-84718 Jun 24 16:32:10.794930 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [req-22be0dd3-1bc9-4bde-a129-f1fbdb82b258 req-cf20beb3-7dea-4f52-93f2-c0ee0c282053 service nova] Acquired lock "compute-rpcapi-router" {{(pid=102149) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:266}} Jun 24 16:32:10.796306 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-ac3b5549-330d-425b-bed9-f42997ceb4d5 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:32:10.796983 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-ac3b5549-330d-425b-bed9-f42997ceb4d5 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:32:10.797987 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-ac3b5549-330d-425b-bed9-f42997ceb4d5 None None] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:32:10.798628 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-ac3b5549-330d-425b-bed9-f42997ceb4d5 None None] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:32:10.804377 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-282e519b-5591-44ea-9f2c-dbca531f42bf tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:32:10.809137 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-282e519b-5591-44ea-9f2c-dbca531f42bf tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:32:10.811257 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.compute.rpcapi [None req-ac3b5549-330d-425b-bed9-f42997ceb4d5 None None] Automatically selected compute RPC version 6.0 from minimum service version 56 Jun 24 16:32:10.812721 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-ac3b5549-330d-425b-bed9-f42997ceb4d5 None None] Releasing lock "compute-rpcapi-router" {{(pid=102149) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:282}} Jun 24 16:32:10.812832 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-282e519b-5591-44ea-9f2c-dbca531f42bf tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:32:10.813947 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-282e519b-5591-44ea-9f2c-dbca531f42bf tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:32:10.842157 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-ac3b5549-330d-425b-bed9-f42997ceb4d5 None None] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.133220 Jun 24 16:32:10.842977 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 22/54] 10.222.0.18 () {64 vars in 1317 bytes} [Fri Jun 24 16:32:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 16:32:10.850153 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [req-442b4733-0934-4b8e-9745-f624e71803c8 req-47472b77-922b-4c66-b610-cb458dbac8b7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4eb74274-8b99-455f-8f03-681fbea6b6e0", "name": "network-vif-plugged", "status": "completed", "tag": "11484e4d-aa90-40ce-8ec1-7ff4b72f6d02"}]} {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 16:32:10.855459 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 24 16:32:10.855459 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: warnings.warn(msg) Jun 24 16:32:10.873353 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [req-442b4733-0934-4b8e-9745-f624e71803c8 req-47472b77-922b-4c66-b610-cb458dbac8b7 service nova] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:32:10.875908 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [req-442b4733-0934-4b8e-9745-f624e71803c8 req-47472b77-922b-4c66-b610-cb458dbac8b7 service nova] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:32:10.915450 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.compute.server_external_events [req-442b4733-0934-4b8e-9745-f624e71803c8 req-47472b77-922b-4c66-b610-cb458dbac8b7 service nova] Creating event network-vif-plugged:11484e4d-aa90-40ce-8ec1-7ff4b72f6d02 for instance 4eb74274-8b99-455f-8f03-681fbea6b6e0 on hv-cinder-84718 Jun 24 16:32:10.925249 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [req-442b4733-0934-4b8e-9745-f624e71803c8 req-47472b77-922b-4c66-b610-cb458dbac8b7 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078377 Jun 24 16:32:10.933519 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 23/55] 10.222.0.18 () {64 vars in 1317 bytes} [Fri Jun 24 16:32:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 16:32:10.939425 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-723fb9f0-4686-40d1-8e78-2f5d3d05a4fa tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Calling method '>' {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:32:10.940237 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-723fb9f0-4686-40d1-8e78-2f5d3d05a4fa tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] [instance: 2fa4f019-3cbd-4b41-a0fc-6513f46474c0] Fetching instance by UUID {{(pid=102149) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:32:10.965790 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-723fb9f0-4686-40d1-8e78-2f5d3d05a4fa tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:32:10.969391 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-723fb9f0-4686-40d1-8e78-2f5d3d05a4fa tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:32:10.970951 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-723fb9f0-4686-40d1-8e78-2f5d3d05a4fa tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:32:10.971524 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-723fb9f0-4686-40d1-8e78-2f5d3d05a4fa tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:32:12.665442 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-282e519b-5591-44ea-9f2c-dbca531f42bf tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c286a3f03048689e5ec552bb89c161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09584de3a4b14c5a90eb9b1c2149d6fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:32:12.677145 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-282e519b-5591-44ea-9f2c-dbca531f42bf tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] 10.222.0.18 "GET /compute/v2.1/servers/1c690e22-ec9b-423d-9f32-e01ffb3fa4b1" status: 200 len: 1321 microversion: 2.1 time: 1.926271 Jun 24 16:32:12.677743 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 33/56] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:32:10 2022] GET /compute/v2.1/servers/1c690e22-ec9b-423d-9f32-e01ffb3fa4b1 => generated 1321 bytes in 1927 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 16:32:12.696695 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-8b15f1ef-c79b-4bd7-935d-71b8632ecce9 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Calling method '>' {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:32:12.697318 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-8b15f1ef-c79b-4bd7-935d-71b8632ecce9 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] [instance: 30b3ffec-7110-4b4d-9482-2451914c166f] Fetching instance by UUID {{(pid=102148) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:32:12.722124 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-8b15f1ef-c79b-4bd7-935d-71b8632ecce9 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:32:12.723461 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-8b15f1ef-c79b-4bd7-935d-71b8632ecce9 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:32:12.724424 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-8b15f1ef-c79b-4bd7-935d-71b8632ecce9 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:32:12.725003 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-8b15f1ef-c79b-4bd7-935d-71b8632ecce9 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:32:13.021858 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-723fb9f0-4686-40d1-8e78-2f5d3d05a4fa tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '499faf87cf8c41ae823b2566e4c2d8ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606ba814a2d8408ab0856d539ca79b4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:32:13.051773 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-723fb9f0-4686-40d1-8e78-2f5d3d05a4fa tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] 10.222.0.18 "GET /compute/v2.1/servers/2fa4f019-3cbd-4b41-a0fc-6513f46474c0" status: 200 len: 1366 microversion: 2.1 time: 2.111718 Jun 24 16:32:13.052890 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 24/57] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:32:10 2022] GET /compute/v2.1/servers/2fa4f019-3cbd-4b41-a0fc-6513f46474c0 => generated 1366 bytes in 2119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 16:32:13.059401 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-72a8de9a-89a3-44c8-9e57-870861ce04c0 tempest-DeleteServersTestJSON-368419735 tempest-DeleteServersTestJSON-368419735-project] Calling method '>' {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:32:13.060401 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-72a8de9a-89a3-44c8-9e57-870861ce04c0 tempest-DeleteServersTestJSON-368419735 tempest-DeleteServersTestJSON-368419735-project] [instance: 618dfcb0-fc23-4985-a7e0-9ec51837519b] Fetching instance by UUID {{(pid=102149) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:32:13.078509 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-72a8de9a-89a3-44c8-9e57-870861ce04c0 tempest-DeleteServersTestJSON-368419735 tempest-DeleteServersTestJSON-368419735-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:32:13.079640 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-72a8de9a-89a3-44c8-9e57-870861ce04c0 tempest-DeleteServersTestJSON-368419735 tempest-DeleteServersTestJSON-368419735-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:32:13.081440 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-72a8de9a-89a3-44c8-9e57-870861ce04c0 tempest-DeleteServersTestJSON-368419735 tempest-DeleteServersTestJSON-368419735-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:32:13.083308 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-72a8de9a-89a3-44c8-9e57-870861ce04c0 tempest-DeleteServersTestJSON-368419735 tempest-DeleteServersTestJSON-368419735-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:32:13.435795 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-8b15f1ef-c79b-4bd7-935d-71b8632ecce9 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7489b29cb3ef47d78dfd55794f338b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065254ebe67545639644fcbc6bd9fc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:32:13.463868 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-8b15f1ef-c79b-4bd7-935d-71b8632ecce9 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7489b29cb3ef47d78dfd55794f338b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065254ebe67545639644fcbc6bd9fc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:32:13.466633 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-8b15f1ef-c79b-4bd7-935d-71b8632ecce9 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7489b29cb3ef47d78dfd55794f338b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065254ebe67545639644fcbc6bd9fc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:32:13.470135 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-8b15f1ef-c79b-4bd7-935d-71b8632ecce9 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] 10.222.0.18 "GET /compute/v2.1/servers/30b3ffec-7110-4b4d-9482-2451914c166f" status: 200 len: 1406 microversion: 2.20 time: 0.789952 Jun 24 16:32:13.475539 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 34/58] 10.222.0.18 () {60 vars in 1276 bytes} [Fri Jun 24 16:32:12 2022] GET /compute/v2.1/servers/30b3ffec-7110-4b4d-9482-2451914c166f => generated 1406 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 16:32:13.489919 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [req-5bd05910-10df-4976-88b8-61c5f75bd844 req-ad0f933a-ae2d-452f-9b63-c731b66f0121 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2fa4f019-3cbd-4b41-a0fc-6513f46474c0", "tag": "fc075890-b996-4078-bc3c-b93d621d7267"}]} {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 16:32:13.505249 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 24 16:32:13.505249 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: warnings.warn(msg) Jun 24 16:32:13.544042 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [req-5bd05910-10df-4976-88b8-61c5f75bd844 req-ad0f933a-ae2d-452f-9b63-c731b66f0121 service nova] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:32:13.545346 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [req-5bd05910-10df-4976-88b8-61c5f75bd844 req-ad0f933a-ae2d-452f-9b63-c731b66f0121 service nova] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:32:13.578445 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.compute.server_external_events [req-5bd05910-10df-4976-88b8-61c5f75bd844 req-ad0f933a-ae2d-452f-9b63-c731b66f0121 service nova] Creating event network-changed:fc075890-b996-4078-bc3c-b93d621d7267 for instance 2fa4f019-3cbd-4b41-a0fc-6513f46474c0 on hv-cinder-84718 Jun 24 16:32:13.600243 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [req-5bd05910-10df-4976-88b8-61c5f75bd844 req-ad0f933a-ae2d-452f-9b63-c731b66f0121 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.116450 Jun 24 16:32:13.603046 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 35/59] 10.222.0.18 () {64 vars in 1317 bytes} [Fri Jun 24 16:32:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 16:32:13.615711 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [req-898a787b-7bbb-4cfc-8aa7-fc1edb4c0486 req-52cadbf0-77eb-401f-85e9-edb935204858 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1c690e22-ec9b-423d-9f32-e01ffb3fa4b1", "tag": "05c13379-1583-4cb1-b0df-784284e184a4"}]} {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 16:32:13.620185 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 24 16:32:13.620185 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: warnings.warn(msg) Jun 24 16:32:13.638414 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [req-898a787b-7bbb-4cfc-8aa7-fc1edb4c0486 req-52cadbf0-77eb-401f-85e9-edb935204858 service nova] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:32:13.639380 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [req-898a787b-7bbb-4cfc-8aa7-fc1edb4c0486 req-52cadbf0-77eb-401f-85e9-edb935204858 service nova] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:32:13.682398 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.compute.server_external_events [req-898a787b-7bbb-4cfc-8aa7-fc1edb4c0486 req-52cadbf0-77eb-401f-85e9-edb935204858 service nova] Creating event network-changed:05c13379-1583-4cb1-b0df-784284e184a4 for instance 1c690e22-ec9b-423d-9f32-e01ffb3fa4b1 on hv-cinder-84718 Jun 24 16:32:13.713867 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [req-898a787b-7bbb-4cfc-8aa7-fc1edb4c0486 req-52cadbf0-77eb-401f-85e9-edb935204858 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105633 Jun 24 16:32:13.714194 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-72a8de9a-89a3-44c8-9e57-870861ce04c0 tempest-DeleteServersTestJSON-368419735 tempest-DeleteServersTestJSON-368419735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81eaf76db05e41feb86cb793787bdeac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '166c04f72691440d883f2508cc22df58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:32:13.717089 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 36/60] 10.222.0.18 () {64 vars in 1317 bytes} [Fri Jun 24 16:32:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 16:32:13.734371 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-72a8de9a-89a3-44c8-9e57-870861ce04c0 tempest-DeleteServersTestJSON-368419735 tempest-DeleteServersTestJSON-368419735-project] 10.222.0.18 "GET /compute/v2.1/servers/618dfcb0-fc23-4985-a7e0-9ec51837519b" status: 200 len: 1501 microversion: 2.1 time: 0.678328 Jun 24 16:32:13.735436 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-b63fd961-df89-4c78-959b-605d6cbb58cf tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Calling method '>' {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:32:13.735575 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 25/61] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:32:13 2022] GET /compute/v2.1/servers/618dfcb0-fc23-4985-a7e0-9ec51837519b => generated 1501 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 16:32:13.736689 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-b63fd961-df89-4c78-959b-605d6cbb58cf tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] [instance: 1c690e22-ec9b-423d-9f32-e01ffb3fa4b1] Fetching instance by UUID {{(pid=102148) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:32:13.752414 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-b63fd961-df89-4c78-959b-605d6cbb58cf tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:32:13.754025 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-b63fd961-df89-4c78-959b-605d6cbb58cf tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:32:13.755308 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-b63fd961-df89-4c78-959b-605d6cbb58cf tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:32:13.755921 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-b63fd961-df89-4c78-959b-605d6cbb58cf tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:32:14.073697 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-8258f907-ab8f-45f2-ab76-f74034bdf145 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Calling method '>' {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:32:14.077635 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-8258f907-ab8f-45f2-ab76-f74034bdf145 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] [instance: 2fa4f019-3cbd-4b41-a0fc-6513f46474c0] Fetching instance by UUID {{(pid=102149) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:32:14.093937 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-8258f907-ab8f-45f2-ab76-f74034bdf145 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:32:14.095468 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-8258f907-ab8f-45f2-ab76-f74034bdf145 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:32:14.098495 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-8258f907-ab8f-45f2-ab76-f74034bdf145 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:32:14.099411 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-8258f907-ab8f-45f2-ab76-f74034bdf145 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:32:14.192546 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-b63fd961-df89-4c78-959b-605d6cbb58cf tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c286a3f03048689e5ec552bb89c161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09584de3a4b14c5a90eb9b1c2149d6fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:32:14.202228 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-b63fd961-df89-4c78-959b-605d6cbb58cf tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] 10.222.0.18 "GET /compute/v2.1/servers/1c690e22-ec9b-423d-9f32-e01ffb3fa4b1" status: 200 len: 1321 microversion: 2.1 time: 0.480156 Jun 24 16:32:14.203892 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 37/62] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:32:13 2022] GET /compute/v2.1/servers/1c690e22-ec9b-423d-9f32-e01ffb3fa4b1 => generated 1321 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 16:32:14.412149 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-8258f907-ab8f-45f2-ab76-f74034bdf145 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '499faf87cf8c41ae823b2566e4c2d8ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606ba814a2d8408ab0856d539ca79b4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:32:14.421406 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-8258f907-ab8f-45f2-ab76-f74034bdf145 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] 10.222.0.18 "GET /compute/v2.1/servers/2fa4f019-3cbd-4b41-a0fc-6513f46474c0" status: 200 len: 1366 microversion: 2.1 time: 0.355394 Jun 24 16:32:14.423585 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 26/63] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:32:14 2022] GET /compute/v2.1/servers/2fa4f019-3cbd-4b41-a0fc-6513f46474c0 => generated 1366 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 16:32:14.507065 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-6a6909b6-7442-4158-985f-fe14ae996579 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Calling method '>' {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:32:14.507685 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-6a6909b6-7442-4158-985f-fe14ae996579 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] [instance: 30b3ffec-7110-4b4d-9482-2451914c166f] Fetching instance by UUID {{(pid=102148) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:32:14.524314 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-6a6909b6-7442-4158-985f-fe14ae996579 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:32:14.526534 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-6a6909b6-7442-4158-985f-fe14ae996579 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:32:14.527379 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-6a6909b6-7442-4158-985f-fe14ae996579 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:32:14.528019 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-6a6909b6-7442-4158-985f-fe14ae996579 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:32:14.871893 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-6a6909b6-7442-4158-985f-fe14ae996579 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7489b29cb3ef47d78dfd55794f338b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065254ebe67545639644fcbc6bd9fc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:32:14.885356 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-6a6909b6-7442-4158-985f-fe14ae996579 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7489b29cb3ef47d78dfd55794f338b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065254ebe67545639644fcbc6bd9fc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:32:14.887072 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-6a6909b6-7442-4158-985f-fe14ae996579 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7489b29cb3ef47d78dfd55794f338b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065254ebe67545639644fcbc6bd9fc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:32:14.888292 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-6a6909b6-7442-4158-985f-fe14ae996579 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] 10.222.0.18 "GET /compute/v2.1/servers/30b3ffec-7110-4b4d-9482-2451914c166f" status: 200 len: 1406 microversion: 2.20 time: 0.386011 Jun 24 16:32:14.888933 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 38/64] 10.222.0.18 () {60 vars in 1276 bytes} [Fri Jun 24 16:32:14 2022] GET /compute/v2.1/servers/30b3ffec-7110-4b4d-9482-2451914c166f => generated 1406 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 16:32:15.234460 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-07603cee-da38-429a-a1bc-e68ee98e0f60 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Calling method '>' {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:32:15.236102 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-07603cee-da38-429a-a1bc-e68ee98e0f60 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] [instance: 1c690e22-ec9b-423d-9f32-e01ffb3fa4b1] Fetching instance by UUID {{(pid=102149) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:32:15.248465 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-07603cee-da38-429a-a1bc-e68ee98e0f60 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:32:15.250206 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-07603cee-da38-429a-a1bc-e68ee98e0f60 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:32:15.251301 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-07603cee-da38-429a-a1bc-e68ee98e0f60 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:32:15.251928 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-07603cee-da38-429a-a1bc-e68ee98e0f60 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:32:15.440820 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-029b7906-34ff-44cc-8b21-e76f363b2a73 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Calling method '>' {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:32:15.441823 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-029b7906-34ff-44cc-8b21-e76f363b2a73 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] [instance: 2fa4f019-3cbd-4b41-a0fc-6513f46474c0] Fetching instance by UUID {{(pid=102148) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:32:15.450402 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-029b7906-34ff-44cc-8b21-e76f363b2a73 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:32:15.451014 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-029b7906-34ff-44cc-8b21-e76f363b2a73 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:32:15.451995 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-029b7906-34ff-44cc-8b21-e76f363b2a73 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:32:15.452435 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-029b7906-34ff-44cc-8b21-e76f363b2a73 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:32:16.020035 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-07603cee-da38-429a-a1bc-e68ee98e0f60 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c286a3f03048689e5ec552bb89c161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09584de3a4b14c5a90eb9b1c2149d6fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:32:16.051533 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-07603cee-da38-429a-a1bc-e68ee98e0f60 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] 10.222.0.18 "GET /compute/v2.1/servers/1c690e22-ec9b-423d-9f32-e01ffb3fa4b1" status: 200 len: 1321 microversion: 2.1 time: 0.813643 Jun 24 16:32:16.052602 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 27/65] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:32:15 2022] GET /compute/v2.1/servers/1c690e22-ec9b-423d-9f32-e01ffb3fa4b1 => generated 1321 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 16:32:16.061273 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-edd6d365-de20-4534-9d1d-dc0ab3b30068 tempest-DeleteServersTestJSON-368419735 tempest-DeleteServersTestJSON-368419735-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a58cb9ff-1f03-40ad-ac09-e300fa3dc0d7"}} {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 16:32:16.069594 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-edd6d365-de20-4534-9d1d-dc0ab3b30068 tempest-DeleteServersTestJSON-368419735 tempest-DeleteServersTestJSON-368419735-project] [instance: 618dfcb0-fc23-4985-a7e0-9ec51837519b] Fetching instance by UUID {{(pid=102149) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:32:16.091724 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-edd6d365-de20-4534-9d1d-dc0ab3b30068 tempest-DeleteServersTestJSON-368419735 tempest-DeleteServersTestJSON-368419735-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:32:16.092490 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-edd6d365-de20-4534-9d1d-dc0ab3b30068 tempest-DeleteServersTestJSON-368419735 tempest-DeleteServersTestJSON-368419735-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:32:16.093822 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-edd6d365-de20-4534-9d1d-dc0ab3b30068 tempest-DeleteServersTestJSON-368419735 tempest-DeleteServersTestJSON-368419735-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:32:16.094575 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-edd6d365-de20-4534-9d1d-dc0ab3b30068 tempest-DeleteServersTestJSON-368419735 tempest-DeleteServersTestJSON-368419735-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:32:16.129888 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-029b7906-34ff-44cc-8b21-e76f363b2a73 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '499faf87cf8c41ae823b2566e4c2d8ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606ba814a2d8408ab0856d539ca79b4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:32:16.147467 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-029b7906-34ff-44cc-8b21-e76f363b2a73 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] 10.222.0.18 "GET /compute/v2.1/servers/2fa4f019-3cbd-4b41-a0fc-6513f46474c0" status: 200 len: 1366 microversion: 2.1 time: 0.710107 Jun 24 16:32:16.148736 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 39/66] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:32:15 2022] GET /compute/v2.1/servers/2fa4f019-3cbd-4b41-a0fc-6513f46474c0 => generated 1366 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 16:32:16.171345 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-f857ec09-6537-4eeb-adfa-72e5e26ff87d tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Calling method '>' {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:32:16.178027 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-f857ec09-6537-4eeb-adfa-72e5e26ff87d tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] [instance: 30b3ffec-7110-4b4d-9482-2451914c166f] Fetching instance by UUID {{(pid=102148) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:32:16.194848 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-f857ec09-6537-4eeb-adfa-72e5e26ff87d tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:32:16.195626 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-f857ec09-6537-4eeb-adfa-72e5e26ff87d tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:32:16.197495 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-f857ec09-6537-4eeb-adfa-72e5e26ff87d tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:32:16.198264 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-f857ec09-6537-4eeb-adfa-72e5e26ff87d tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:32:16.665242 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-f857ec09-6537-4eeb-adfa-72e5e26ff87d tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7489b29cb3ef47d78dfd55794f338b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065254ebe67545639644fcbc6bd9fc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:32:16.686344 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-f857ec09-6537-4eeb-adfa-72e5e26ff87d tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7489b29cb3ef47d78dfd55794f338b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065254ebe67545639644fcbc6bd9fc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:32:16.689718 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-f857ec09-6537-4eeb-adfa-72e5e26ff87d tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7489b29cb3ef47d78dfd55794f338b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065254ebe67545639644fcbc6bd9fc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:32:16.692146 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-f857ec09-6537-4eeb-adfa-72e5e26ff87d tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] 10.222.0.18 "GET /compute/v2.1/servers/30b3ffec-7110-4b4d-9482-2451914c166f" status: 200 len: 1406 microversion: 2.20 time: 0.541308 Jun 24 16:32:16.693413 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 40/67] 10.222.0.18 () {60 vars in 1276 bytes} [Fri Jun 24 16:32:16 2022] GET /compute/v2.1/servers/30b3ffec-7110-4b4d-9482-2451914c166f => generated 1406 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 16:32:17.084280 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-66020076-c46a-44a3-9722-40da2e8ce774 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Calling method '>' {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:32:17.085429 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-66020076-c46a-44a3-9722-40da2e8ce774 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] [instance: 1c690e22-ec9b-423d-9f32-e01ffb3fa4b1] Fetching instance by UUID {{(pid=102148) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:32:17.099851 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-66020076-c46a-44a3-9722-40da2e8ce774 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:32:17.100650 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-66020076-c46a-44a3-9722-40da2e8ce774 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:32:17.102095 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-66020076-c46a-44a3-9722-40da2e8ce774 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:32:17.102934 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-66020076-c46a-44a3-9722-40da2e8ce774 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:32:17.594089 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-66020076-c46a-44a3-9722-40da2e8ce774 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c286a3f03048689e5ec552bb89c161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09584de3a4b14c5a90eb9b1c2149d6fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:32:17.611125 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-66020076-c46a-44a3-9722-40da2e8ce774 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] 10.222.0.18 "GET /compute/v2.1/servers/1c690e22-ec9b-423d-9f32-e01ffb3fa4b1" status: 200 len: 1321 microversion: 2.1 time: 0.536488 Jun 24 16:32:17.614574 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 41/68] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:32:17 2022] GET /compute/v2.1/servers/1c690e22-ec9b-423d-9f32-e01ffb3fa4b1 => generated 1321 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 16:32:17.625572 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-23d04306-936d-40a1-8494-24de1fa6e484 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Calling method '>' {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:32:17.627335 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-23d04306-936d-40a1-8494-24de1fa6e484 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] [instance: 2fa4f019-3cbd-4b41-a0fc-6513f46474c0] Fetching instance by UUID {{(pid=102148) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:32:17.647235 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-23d04306-936d-40a1-8494-24de1fa6e484 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:32:17.649207 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-23d04306-936d-40a1-8494-24de1fa6e484 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:32:17.651941 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-23d04306-936d-40a1-8494-24de1fa6e484 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:32:17.653029 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-23d04306-936d-40a1-8494-24de1fa6e484 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:32:18.157434 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-23d04306-936d-40a1-8494-24de1fa6e484 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '499faf87cf8c41ae823b2566e4c2d8ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606ba814a2d8408ab0856d539ca79b4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:32:18.182396 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-23d04306-936d-40a1-8494-24de1fa6e484 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] 10.222.0.18 "GET /compute/v2.1/servers/2fa4f019-3cbd-4b41-a0fc-6513f46474c0" status: 200 len: 1366 microversion: 2.1 time: 0.564994 Jun 24 16:32:18.183429 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 42/69] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:32:17 2022] GET /compute/v2.1/servers/2fa4f019-3cbd-4b41-a0fc-6513f46474c0 => generated 1366 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 16:32:18.202617 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-65c945f9-0e41-430b-b07d-cf8aa7371883 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Calling method '>' {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:32:18.203651 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-65c945f9-0e41-430b-b07d-cf8aa7371883 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] [instance: 30b3ffec-7110-4b4d-9482-2451914c166f] Fetching instance by UUID {{(pid=102148) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:32:18.217469 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-65c945f9-0e41-430b-b07d-cf8aa7371883 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:32:18.218228 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-65c945f9-0e41-430b-b07d-cf8aa7371883 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:32:18.219532 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-65c945f9-0e41-430b-b07d-cf8aa7371883 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:32:18.220274 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-65c945f9-0e41-430b-b07d-cf8aa7371883 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:32:18.978036 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-65c945f9-0e41-430b-b07d-cf8aa7371883 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7489b29cb3ef47d78dfd55794f338b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065254ebe67545639644fcbc6bd9fc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:32:18.989993 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-65c945f9-0e41-430b-b07d-cf8aa7371883 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7489b29cb3ef47d78dfd55794f338b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065254ebe67545639644fcbc6bd9fc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:32:18.995861 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-65c945f9-0e41-430b-b07d-cf8aa7371883 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7489b29cb3ef47d78dfd55794f338b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065254ebe67545639644fcbc6bd9fc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:32:18.997077 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-65c945f9-0e41-430b-b07d-cf8aa7371883 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] 10.222.0.18 "GET /compute/v2.1/servers/30b3ffec-7110-4b4d-9482-2451914c166f" status: 200 len: 1406 microversion: 2.20 time: 0.800368 Jun 24 16:32:18.997650 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 43/70] 10.222.0.18 () {60 vars in 1276 bytes} [Fri Jun 24 16:32:18 2022] GET /compute/v2.1/servers/30b3ffec-7110-4b4d-9482-2451914c166f => generated 1406 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 16:32:19.027174 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-edd6d365-de20-4534-9d1d-dc0ab3b30068 tempest-DeleteServersTestJSON-368419735 tempest-DeleteServersTestJSON-368419735-project] 10.222.0.18 "POST /compute/v2.1/servers/618dfcb0-fc23-4985-a7e0-9ec51837519b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.972313 Jun 24 16:32:19.028055 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-95b59c20-714a-4d47-9e39-bf58a6de819d tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Calling method '>' {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:32:19.029238 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 28/71] 10.222.0.18 () {60 vars in 1322 bytes} [Fri Jun 24 16:32:16 2022] POST /compute/v2.1/servers/618dfcb0-fc23-4985-a7e0-9ec51837519b/os-volume_attachments => generated 194 bytes in 2976 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 16:32:19.037214 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-95b59c20-714a-4d47-9e39-bf58a6de819d tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] [instance: 1c690e22-ec9b-423d-9f32-e01ffb3fa4b1] Fetching instance by UUID {{(pid=102148) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:32:19.070794 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-95b59c20-714a-4d47-9e39-bf58a6de819d tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:32:19.071839 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-95b59c20-714a-4d47-9e39-bf58a6de819d tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:32:19.073865 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-95b59c20-714a-4d47-9e39-bf58a6de819d tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:32:19.074948 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-95b59c20-714a-4d47-9e39-bf58a6de819d tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:32:19.219431 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-635e3f85-0fd2-4c2c-af89-380737d6f6a8 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Calling method '>' {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:32:19.224215 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-635e3f85-0fd2-4c2c-af89-380737d6f6a8 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] [instance: 2fa4f019-3cbd-4b41-a0fc-6513f46474c0] Fetching instance by UUID {{(pid=102149) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:32:19.264170 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-635e3f85-0fd2-4c2c-af89-380737d6f6a8 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:32:19.266188 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-635e3f85-0fd2-4c2c-af89-380737d6f6a8 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:32:19.271718 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-635e3f85-0fd2-4c2c-af89-380737d6f6a8 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:32:19.273113 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-635e3f85-0fd2-4c2c-af89-380737d6f6a8 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:32:20.452348 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-635e3f85-0fd2-4c2c-af89-380737d6f6a8 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '499faf87cf8c41ae823b2566e4c2d8ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606ba814a2d8408ab0856d539ca79b4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:32:20.483685 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-635e3f85-0fd2-4c2c-af89-380737d6f6a8 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] 10.222.0.18 "GET /compute/v2.1/servers/2fa4f019-3cbd-4b41-a0fc-6513f46474c0" status: 200 len: 1366 microversion: 2.1 time: 1.277620 Jun 24 16:32:20.485032 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 29/72] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:32:19 2022] GET /compute/v2.1/servers/2fa4f019-3cbd-4b41-a0fc-6513f46474c0 => generated 1366 bytes in 1282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 16:32:20.504562 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-11c5ef88-59a1-4c31-b3d2-7817e720dc41 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Calling method '>' {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:32:20.508666 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-11c5ef88-59a1-4c31-b3d2-7817e720dc41 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] [instance: 30b3ffec-7110-4b4d-9482-2451914c166f] Fetching instance by UUID {{(pid=102149) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:32:20.515949 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-95b59c20-714a-4d47-9e39-bf58a6de819d tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c286a3f03048689e5ec552bb89c161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09584de3a4b14c5a90eb9b1c2149d6fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:32:20.535633 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-11c5ef88-59a1-4c31-b3d2-7817e720dc41 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:32:20.538191 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-11c5ef88-59a1-4c31-b3d2-7817e720dc41 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:32:20.541470 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-11c5ef88-59a1-4c31-b3d2-7817e720dc41 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:32:20.543343 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-11c5ef88-59a1-4c31-b3d2-7817e720dc41 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:32:20.545114 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-95b59c20-714a-4d47-9e39-bf58a6de819d tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] 10.222.0.18 "GET /compute/v2.1/servers/1c690e22-ec9b-423d-9f32-e01ffb3fa4b1" status: 200 len: 1321 microversion: 2.1 time: 1.523784 Jun 24 16:32:20.546183 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 44/73] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:32:18 2022] GET /compute/v2.1/servers/1c690e22-ec9b-423d-9f32-e01ffb3fa4b1 => generated 1321 bytes in 1548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 16:32:21.516941 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-806a2912-e456-46f8-9772-43fbc1236dee tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Calling method '>' {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:32:21.520211 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-806a2912-e456-46f8-9772-43fbc1236dee tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] [instance: 2fa4f019-3cbd-4b41-a0fc-6513f46474c0] Fetching instance by UUID {{(pid=102148) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:32:21.553156 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-806a2912-e456-46f8-9772-43fbc1236dee tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:32:21.554055 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-806a2912-e456-46f8-9772-43fbc1236dee tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:32:21.558651 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-806a2912-e456-46f8-9772-43fbc1236dee tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:32:21.559763 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-806a2912-e456-46f8-9772-43fbc1236dee tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:32:21.851827 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-11c5ef88-59a1-4c31-b3d2-7817e720dc41 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7489b29cb3ef47d78dfd55794f338b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065254ebe67545639644fcbc6bd9fc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:32:21.866988 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-11c5ef88-59a1-4c31-b3d2-7817e720dc41 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7489b29cb3ef47d78dfd55794f338b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065254ebe67545639644fcbc6bd9fc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:32:21.873743 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-11c5ef88-59a1-4c31-b3d2-7817e720dc41 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7489b29cb3ef47d78dfd55794f338b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065254ebe67545639644fcbc6bd9fc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:32:21.875142 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-11c5ef88-59a1-4c31-b3d2-7817e720dc41 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] 10.222.0.18 "GET /compute/v2.1/servers/30b3ffec-7110-4b4d-9482-2451914c166f" status: 200 len: 1406 microversion: 2.20 time: 1.387737 Jun 24 16:32:21.877719 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 30/74] 10.222.0.18 () {60 vars in 1276 bytes} [Fri Jun 24 16:32:20 2022] GET /compute/v2.1/servers/30b3ffec-7110-4b4d-9482-2451914c166f => generated 1406 bytes in 1392 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 16:32:21.896297 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-f1dff7cf-ecac-4f98-b8e7-d7c664f4ce84 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Calling method '>' {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:32:21.897108 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-f1dff7cf-ecac-4f98-b8e7-d7c664f4ce84 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] [instance: 1c690e22-ec9b-423d-9f32-e01ffb3fa4b1] Fetching instance by UUID {{(pid=102149) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:32:21.904696 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-f1dff7cf-ecac-4f98-b8e7-d7c664f4ce84 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:32:21.911491 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-f1dff7cf-ecac-4f98-b8e7-d7c664f4ce84 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:32:21.912599 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-f1dff7cf-ecac-4f98-b8e7-d7c664f4ce84 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:32:21.913207 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-f1dff7cf-ecac-4f98-b8e7-d7c664f4ce84 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:32:22.731177 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-806a2912-e456-46f8-9772-43fbc1236dee tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '499faf87cf8c41ae823b2566e4c2d8ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606ba814a2d8408ab0856d539ca79b4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:32:22.740602 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-f1dff7cf-ecac-4f98-b8e7-d7c664f4ce84 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c286a3f03048689e5ec552bb89c161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09584de3a4b14c5a90eb9b1c2149d6fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:32:22.768770 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-806a2912-e456-46f8-9772-43fbc1236dee tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] 10.222.0.18 "GET /compute/v2.1/servers/2fa4f019-3cbd-4b41-a0fc-6513f46474c0" status: 200 len: 1366 microversion: 2.1 time: 1.258407 Jun 24 16:32:22.772193 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 45/75] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:32:21 2022] GET /compute/v2.1/servers/2fa4f019-3cbd-4b41-a0fc-6513f46474c0 => generated 1366 bytes in 1263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 16:32:22.775840 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-f1dff7cf-ecac-4f98-b8e7-d7c664f4ce84 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] 10.222.0.18 "GET /compute/v2.1/servers/1c690e22-ec9b-423d-9f32-e01ffb3fa4b1" status: 200 len: 1321 microversion: 2.1 time: 0.883729 Jun 24 16:32:22.791178 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 31/76] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:32:21 2022] GET /compute/v2.1/servers/1c690e22-ec9b-423d-9f32-e01ffb3fa4b1 => generated 1321 bytes in 912 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 16:32:22.793082 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [req-631fd882-fb75-4eea-95dd-886485a64401 req-a2de761a-d49f-4a8a-9892-46ccacd8a61e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "30b3ffec-7110-4b4d-9482-2451914c166f", "name": "network-vif-plugged", "status": "completed", "tag": "78a4e31b-a598-4436-bdeb-0904cefd7b6e"}]} {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 16:32:22.799564 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 24 16:32:22.799564 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: warnings.warn(msg) Jun 24 16:32:22.837829 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [req-631fd882-fb75-4eea-95dd-886485a64401 req-a2de761a-d49f-4a8a-9892-46ccacd8a61e service nova] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:32:22.839297 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [req-631fd882-fb75-4eea-95dd-886485a64401 req-a2de761a-d49f-4a8a-9892-46ccacd8a61e service nova] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:32:22.873272 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.compute.server_external_events [req-631fd882-fb75-4eea-95dd-886485a64401 req-a2de761a-d49f-4a8a-9892-46ccacd8a61e service nova] Creating event network-vif-plugged:78a4e31b-a598-4436-bdeb-0904cefd7b6e for instance 30b3ffec-7110-4b4d-9482-2451914c166f on hv-cinder-84718 Jun 24 16:32:22.894988 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [req-631fd882-fb75-4eea-95dd-886485a64401 req-a2de761a-d49f-4a8a-9892-46ccacd8a61e service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.119740 Jun 24 16:32:22.896430 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 46/77] 10.222.0.18 () {64 vars in 1317 bytes} [Fri Jun 24 16:32:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 16:32:22.913720 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-c6143277-40af-435c-9758-1aa355a3f996 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Calling method '>' {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:32:22.914565 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-c6143277-40af-435c-9758-1aa355a3f996 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] [instance: 30b3ffec-7110-4b4d-9482-2451914c166f] Fetching instance by UUID {{(pid=102149) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:32:22.971128 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-c6143277-40af-435c-9758-1aa355a3f996 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:32:22.973474 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-c6143277-40af-435c-9758-1aa355a3f996 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:32:22.979147 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-c6143277-40af-435c-9758-1aa355a3f996 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:32:22.981508 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-c6143277-40af-435c-9758-1aa355a3f996 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:32:23.491285 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-c6143277-40af-435c-9758-1aa355a3f996 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7489b29cb3ef47d78dfd55794f338b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065254ebe67545639644fcbc6bd9fc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:32:23.500901 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-c6143277-40af-435c-9758-1aa355a3f996 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7489b29cb3ef47d78dfd55794f338b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065254ebe67545639644fcbc6bd9fc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:32:23.502434 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-c6143277-40af-435c-9758-1aa355a3f996 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7489b29cb3ef47d78dfd55794f338b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065254ebe67545639644fcbc6bd9fc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:32:23.504327 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-c6143277-40af-435c-9758-1aa355a3f996 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] 10.222.0.18 "GET /compute/v2.1/servers/30b3ffec-7110-4b4d-9482-2451914c166f" status: 200 len: 1406 microversion: 2.20 time: 0.597785 Jun 24 16:32:23.515425 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 32/78] 10.222.0.18 () {60 vars in 1276 bytes} [Fri Jun 24 16:32:22 2022] GET /compute/v2.1/servers/30b3ffec-7110-4b4d-9482-2451914c166f => generated 1406 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 16:32:23.812879 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-9084ad21-e9e5-4984-b0d0-82ec853d0de3 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Calling method '>' {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:32:23.817811 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-b1f28b2f-672e-4f59-b684-3f331059f5cc tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Calling method '>' {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:32:23.819776 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-9084ad21-e9e5-4984-b0d0-82ec853d0de3 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] [instance: 2fa4f019-3cbd-4b41-a0fc-6513f46474c0] Fetching instance by UUID {{(pid=102148) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:32:23.821488 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-b1f28b2f-672e-4f59-b684-3f331059f5cc tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] [instance: 1c690e22-ec9b-423d-9f32-e01ffb3fa4b1] Fetching instance by UUID {{(pid=102149) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:32:23.838807 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-9084ad21-e9e5-4984-b0d0-82ec853d0de3 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:32:23.840557 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-9084ad21-e9e5-4984-b0d0-82ec853d0de3 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:32:23.842991 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-9084ad21-e9e5-4984-b0d0-82ec853d0de3 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:32:23.844612 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-9084ad21-e9e5-4984-b0d0-82ec853d0de3 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:32:23.852779 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-b1f28b2f-672e-4f59-b684-3f331059f5cc tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:32:23.853524 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-b1f28b2f-672e-4f59-b684-3f331059f5cc tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:32:23.854967 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-b1f28b2f-672e-4f59-b684-3f331059f5cc tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:32:23.855597 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-b1f28b2f-672e-4f59-b684-3f331059f5cc tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:32:24.941381 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-b1f28b2f-672e-4f59-b684-3f331059f5cc tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c286a3f03048689e5ec552bb89c161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09584de3a4b14c5a90eb9b1c2149d6fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:32:24.966347 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-9084ad21-e9e5-4984-b0d0-82ec853d0de3 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '499faf87cf8c41ae823b2566e4c2d8ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606ba814a2d8408ab0856d539ca79b4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:32:24.984815 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-b1f28b2f-672e-4f59-b684-3f331059f5cc tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] 10.222.0.18 "GET /compute/v2.1/servers/1c690e22-ec9b-423d-9f32-e01ffb3fa4b1" status: 200 len: 1321 microversion: 2.1 time: 1.178953 Jun 24 16:32:24.985806 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 33/79] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:32:23 2022] GET /compute/v2.1/servers/1c690e22-ec9b-423d-9f32-e01ffb3fa4b1 => generated 1321 bytes in 1181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 16:32:25.025035 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-9084ad21-e9e5-4984-b0d0-82ec853d0de3 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] 10.222.0.18 "GET /compute/v2.1/servers/2fa4f019-3cbd-4b41-a0fc-6513f46474c0" status: 200 len: 1366 microversion: 2.1 time: 1.217631 Jun 24 16:32:25.038662 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 47/80] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:32:23 2022] GET /compute/v2.1/servers/2fa4f019-3cbd-4b41-a0fc-6513f46474c0 => generated 1366 bytes in 1234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 16:32:25.047657 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-06497552-4351-4bad-8c64-392f342eb76f tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Calling method '>' {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:32:25.060105 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-06497552-4351-4bad-8c64-392f342eb76f tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] [instance: 30b3ffec-7110-4b4d-9482-2451914c166f] Fetching instance by UUID {{(pid=102149) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:32:25.078312 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-06497552-4351-4bad-8c64-392f342eb76f tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:32:25.080563 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-06497552-4351-4bad-8c64-392f342eb76f tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:32:25.082715 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-06497552-4351-4bad-8c64-392f342eb76f tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:32:25.095790 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-06497552-4351-4bad-8c64-392f342eb76f tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:32:25.715459 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-06497552-4351-4bad-8c64-392f342eb76f tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7489b29cb3ef47d78dfd55794f338b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065254ebe67545639644fcbc6bd9fc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:32:25.730040 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [req-4a4442ee-11dc-410f-9268-045685cae3de req-b5a9cb39-9002-4354-bdb4-a749119069a2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1c690e22-ec9b-423d-9f32-e01ffb3fa4b1", "name": "network-vif-plugged", "status": "completed", "tag": "05c13379-1583-4cb1-b0df-784284e184a4"}]} {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 16:32:25.733805 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 24 16:32:25.733805 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: warnings.warn(msg) Jun 24 16:32:25.749938 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [req-4a4442ee-11dc-410f-9268-045685cae3de req-b5a9cb39-9002-4354-bdb4-a749119069a2 service nova] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:32:25.749938 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [req-4a4442ee-11dc-410f-9268-045685cae3de req-b5a9cb39-9002-4354-bdb4-a749119069a2 service nova] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:32:25.750300 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-06497552-4351-4bad-8c64-392f342eb76f tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7489b29cb3ef47d78dfd55794f338b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065254ebe67545639644fcbc6bd9fc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:32:25.753781 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-06497552-4351-4bad-8c64-392f342eb76f tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7489b29cb3ef47d78dfd55794f338b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065254ebe67545639644fcbc6bd9fc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:32:25.755871 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-06497552-4351-4bad-8c64-392f342eb76f tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] 10.222.0.18 "GET /compute/v2.1/servers/30b3ffec-7110-4b4d-9482-2451914c166f" status: 200 len: 1406 microversion: 2.20 time: 0.739337 Jun 24 16:32:25.756775 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 34/81] 10.222.0.18 () {60 vars in 1276 bytes} [Fri Jun 24 16:32:25 2022] GET /compute/v2.1/servers/30b3ffec-7110-4b4d-9482-2451914c166f => generated 1406 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 16:32:25.779766 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.compute.server_external_events [req-4a4442ee-11dc-410f-9268-045685cae3de req-b5a9cb39-9002-4354-bdb4-a749119069a2 service nova] Creating event network-vif-plugged:05c13379-1583-4cb1-b0df-784284e184a4 for instance 1c690e22-ec9b-423d-9f32-e01ffb3fa4b1 on hv-cinder-84718 Jun 24 16:32:25.787271 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [req-4a4442ee-11dc-410f-9268-045685cae3de req-b5a9cb39-9002-4354-bdb4-a749119069a2 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066725 Jun 24 16:32:25.788376 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 48/82] 10.222.0.18 () {64 vars in 1317 bytes} [Fri Jun 24 16:32:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 16:32:26.013409 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-4613cbc7-6e01-4a0a-863f-5a6a04e92adc tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Calling method '>' {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:32:26.015211 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-4613cbc7-6e01-4a0a-863f-5a6a04e92adc tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] [instance: 1c690e22-ec9b-423d-9f32-e01ffb3fa4b1] Fetching instance by UUID {{(pid=102149) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:32:26.030713 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-4613cbc7-6e01-4a0a-863f-5a6a04e92adc tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:32:26.031986 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-4613cbc7-6e01-4a0a-863f-5a6a04e92adc tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:32:26.033778 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-4613cbc7-6e01-4a0a-863f-5a6a04e92adc tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:32:26.035513 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-4613cbc7-6e01-4a0a-863f-5a6a04e92adc tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:32:26.058679 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-8e7ce446-7d60-467d-a654-3754a5e6f63b tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Calling method '>' {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:32:26.061967 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-8e7ce446-7d60-467d-a654-3754a5e6f63b tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] [instance: 2fa4f019-3cbd-4b41-a0fc-6513f46474c0] Fetching instance by UUID {{(pid=102148) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:32:26.081510 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-8e7ce446-7d60-467d-a654-3754a5e6f63b tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:32:26.082833 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-8e7ce446-7d60-467d-a654-3754a5e6f63b tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:32:26.084721 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-8e7ce446-7d60-467d-a654-3754a5e6f63b tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:32:26.085663 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-8e7ce446-7d60-467d-a654-3754a5e6f63b tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:32:26.740485 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-4613cbc7-6e01-4a0a-863f-5a6a04e92adc tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c286a3f03048689e5ec552bb89c161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09584de3a4b14c5a90eb9b1c2149d6fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:32:26.746992 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-8e7ce446-7d60-467d-a654-3754a5e6f63b tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '499faf87cf8c41ae823b2566e4c2d8ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606ba814a2d8408ab0856d539ca79b4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:32:26.774013 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-4613cbc7-6e01-4a0a-863f-5a6a04e92adc tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] 10.222.0.18 "GET /compute/v2.1/servers/1c690e22-ec9b-423d-9f32-e01ffb3fa4b1" status: 200 len: 1321 microversion: 2.1 time: 0.764633 Jun 24 16:32:26.782661 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-8e7ce446-7d60-467d-a654-3754a5e6f63b tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] 10.222.0.18 "GET /compute/v2.1/servers/2fa4f019-3cbd-4b41-a0fc-6513f46474c0" status: 200 len: 1366 microversion: 2.1 time: 0.723771 Jun 24 16:32:26.786078 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 49/83] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:32:26 2022] GET /compute/v2.1/servers/2fa4f019-3cbd-4b41-a0fc-6513f46474c0 => generated 1366 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 16:32:26.799670 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 35/84] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:32:26 2022] GET /compute/v2.1/servers/1c690e22-ec9b-423d-9f32-e01ffb3fa4b1 => generated 1321 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 16:32:26.813003 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-875a973b-737c-443b-888c-b2afbbca4710 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Calling method '>' {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:32:26.813454 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-875a973b-737c-443b-888c-b2afbbca4710 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] [instance: 30b3ffec-7110-4b4d-9482-2451914c166f] Fetching instance by UUID {{(pid=102148) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:32:26.830347 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-875a973b-737c-443b-888c-b2afbbca4710 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:32:26.830829 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-875a973b-737c-443b-888c-b2afbbca4710 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:32:26.831647 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-875a973b-737c-443b-888c-b2afbbca4710 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:32:26.832086 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-875a973b-737c-443b-888c-b2afbbca4710 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:32:26.909419 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-1186cded-24ce-4818-b88e-6a60c4bc4ae8 tempest-VolumesActionsTest-1515172499 tempest-VolumesActionsTest-1515172499-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1895752501", "imageRef": "113c9cfb-6cee-4018-9e63-66fae82b3851", "flavorRef": "452", "networks": [{"uuid": "122001b6-bbce-455c-bf04-68783d81a89e"}]}} {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 16:32:27.116598 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.network.neutron [None req-1186cded-24ce-4818-b88e-6a60c4bc4ae8 tempest-VolumesActionsTest-1515172499 tempest-VolumesActionsTest-1515172499-project] validate_networks() for [('122001b6-bbce-455c-bf04-68783d81a89e', None, None, None)] {{(pid=102149) validate_networks /opt/stack/nova/nova/network/neutron.py:2367}} Jun 24 16:32:27.689965 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-875a973b-737c-443b-888c-b2afbbca4710 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7489b29cb3ef47d78dfd55794f338b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065254ebe67545639644fcbc6bd9fc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:32:27.704879 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-875a973b-737c-443b-888c-b2afbbca4710 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7489b29cb3ef47d78dfd55794f338b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065254ebe67545639644fcbc6bd9fc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:32:27.708275 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-875a973b-737c-443b-888c-b2afbbca4710 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7489b29cb3ef47d78dfd55794f338b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065254ebe67545639644fcbc6bd9fc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:32:27.710890 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-875a973b-737c-443b-888c-b2afbbca4710 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] 10.222.0.18 "GET /compute/v2.1/servers/30b3ffec-7110-4b4d-9482-2451914c166f" status: 200 len: 1598 microversion: 2.20 time: 0.906609 Jun 24 16:32:27.712015 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 50/85] 10.222.0.18 () {60 vars in 1276 bytes} [Fri Jun 24 16:32:26 2022] GET /compute/v2.1/servers/30b3ffec-7110-4b4d-9482-2451914c166f => generated 1598 bytes in 925 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 16:32:27.744217 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-b82aa262-00aa-4822-aeb9-98ada704e350 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Calling method '>' {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:32:27.745324 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-b82aa262-00aa-4822-aeb9-98ada704e350 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] [instance: 30b3ffec-7110-4b4d-9482-2451914c166f] Fetching instance by UUID {{(pid=102148) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:32:27.759789 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-b82aa262-00aa-4822-aeb9-98ada704e350 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:32:27.760881 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-b82aa262-00aa-4822-aeb9-98ada704e350 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:32:27.762445 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-b82aa262-00aa-4822-aeb9-98ada704e350 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:32:27.763560 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-b82aa262-00aa-4822-aeb9-98ada704e350 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:32:28.070626 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-b82aa262-00aa-4822-aeb9-98ada704e350 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] 10.222.0.18 "GET /compute/v2.1/servers/30b3ffec-7110-4b4d-9482-2451914c166f/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.333363 Jun 24 16:32:28.073098 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 51/86] 10.222.0.18 () {60 vars in 1315 bytes} [Fri Jun 24 16:32:27 2022] GET /compute/v2.1/servers/30b3ffec-7110-4b4d-9482-2451914c166f/os-interface => generated 284 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 24 16:32:28.096596 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-9cfac72f-d0e7-4054-b6bb-81bb7bd94196 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Calling method '>' {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:32:28.098635 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-9cfac72f-d0e7-4054-b6bb-81bb7bd94196 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] [instance: 2fa4f019-3cbd-4b41-a0fc-6513f46474c0] Fetching instance by UUID {{(pid=102148) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:32:28.133502 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-9cfac72f-d0e7-4054-b6bb-81bb7bd94196 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:32:28.135545 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-9cfac72f-d0e7-4054-b6bb-81bb7bd94196 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:32:28.139248 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-9cfac72f-d0e7-4054-b6bb-81bb7bd94196 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:32:28.144758 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-9cfac72f-d0e7-4054-b6bb-81bb7bd94196 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:32:28.540904 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.virt.hardware [None req-1186cded-24ce-4818-b88e-6a60c4bc4ae8 tempest-VolumesActionsTest-1515172499 tempest-VolumesActionsTest-1515172499-project] Flavor limits 0:0:0 {{(pid=102149) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 24 16:32:28.542023 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.virt.hardware [None req-1186cded-24ce-4818-b88e-6a60c4bc4ae8 tempest-VolumesActionsTest-1515172499 tempest-VolumesActionsTest-1515172499-project] Image limits 0:0:0 {{(pid=102149) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 24 16:32:28.543108 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.virt.hardware [None req-1186cded-24ce-4818-b88e-6a60c4bc4ae8 tempest-VolumesActionsTest-1515172499 tempest-VolumesActionsTest-1515172499-project] Flavor pref 0:0:0 {{(pid=102149) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 24 16:32:28.545853 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.virt.hardware [None req-1186cded-24ce-4818-b88e-6a60c4bc4ae8 tempest-VolumesActionsTest-1515172499 tempest-VolumesActionsTest-1515172499-project] Image pref 0:0:0 {{(pid=102149) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 24 16:32:28.546591 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.virt.hardware [None req-1186cded-24ce-4818-b88e-6a60c4bc4ae8 tempest-VolumesActionsTest-1515172499 tempest-VolumesActionsTest-1515172499-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=102149) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 24 16:32:28.575380 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-1186cded-24ce-4818-b88e-6a60c4bc4ae8 tempest-VolumesActionsTest-1515172499 tempest-VolumesActionsTest-1515172499-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:32:28.576494 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-1186cded-24ce-4818-b88e-6a60c4bc4ae8 tempest-VolumesActionsTest-1515172499 tempest-VolumesActionsTest-1515172499-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:32:28.579102 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-1186cded-24ce-4818-b88e-6a60c4bc4ae8 tempest-VolumesActionsTest-1515172499 tempest-VolumesActionsTest-1515172499-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:32:28.588246 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-1186cded-24ce-4818-b88e-6a60c4bc4ae8 tempest-VolumesActionsTest-1515172499 tempest-VolumesActionsTest-1515172499-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:32:28.665357 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.quota [None req-1186cded-24ce-4818-b88e-6a60c4bc4ae8 tempest-VolumesActionsTest-1515172499 tempest-VolumesActionsTest-1515172499-project] Getting quotas for project 55fd35a8f65244b5a18f841af49d5c7d. Resources: {'ram', 'instances', 'cores'} {{(pid=102149) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jun 24 16:32:28.678553 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.quota [None req-1186cded-24ce-4818-b88e-6a60c4bc4ae8 tempest-VolumesActionsTest-1515172499 tempest-VolumesActionsTest-1515172499-project] Getting quotas for user 8dd95251dce947f8bb6a2739a6557dfe and project 55fd35a8f65244b5a18f841af49d5c7d. Resources: {'ram', 'instances', 'cores'} {{(pid=102149) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jun 24 16:32:28.714853 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-1186cded-24ce-4818-b88e-6a60c4bc4ae8 tempest-VolumesActionsTest-1515172499 tempest-VolumesActionsTest-1515172499-project] Going to run 1 instances... {{(pid=102149) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Jun 24 16:32:28.731033 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-1186cded-24ce-4818-b88e-6a60c4bc4ae8 tempest-VolumesActionsTest-1515172499 tempest-VolumesActionsTest-1515172499-project] [instance: 6d4e660b-2f36-40f0-9d87-14b6146eb533] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='113c9cfb-6cee-4018-9e63-66fae82b3851',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=102149) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1684}} Jun 24 16:32:28.835947 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-9cfac72f-d0e7-4054-b6bb-81bb7bd94196 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '499faf87cf8c41ae823b2566e4c2d8ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606ba814a2d8408ab0856d539ca79b4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:32:28.880039 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-9cfac72f-d0e7-4054-b6bb-81bb7bd94196 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] 10.222.0.18 "GET /compute/v2.1/servers/2fa4f019-3cbd-4b41-a0fc-6513f46474c0" status: 200 len: 1366 microversion: 2.1 time: 0.804506 Jun 24 16:32:28.881023 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 52/87] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:32:28 2022] GET /compute/v2.1/servers/2fa4f019-3cbd-4b41-a0fc-6513f46474c0 => generated 1366 bytes in 807 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 16:32:28.917802 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-1186cded-24ce-4818-b88e-6a60c4bc4ae8 tempest-VolumesActionsTest-1515172499 tempest-VolumesActionsTest-1515172499-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.015002 Jun 24 16:32:28.920797 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-fb8a61e2-8509-4611-86ad-a97afb04d6bb tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Calling method '>' {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:32:28.921882 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-fb8a61e2-8509-4611-86ad-a97afb04d6bb tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] [instance: 1c690e22-ec9b-423d-9f32-e01ffb3fa4b1] Fetching instance by UUID {{(pid=102148) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:32:28.930594 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 36/88] 10.222.0.18 () {60 vars in 1146 bytes} [Fri Jun 24 16:32:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 2030 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 24 16:32:28.943669 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-fb8a61e2-8509-4611-86ad-a97afb04d6bb tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:32:28.956942 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-fb8a61e2-8509-4611-86ad-a97afb04d6bb tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:32:28.959981 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-fb8a61e2-8509-4611-86ad-a97afb04d6bb tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:32:28.961355 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-fb8a61e2-8509-4611-86ad-a97afb04d6bb tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:32:28.962854 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-6a2d4e62-40e6-4325-8443-727dd030fc7e tempest-VolumesActionsTest-1515172499 tempest-VolumesActionsTest-1515172499-project] Calling method '>' {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:32:28.968426 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-6a2d4e62-40e6-4325-8443-727dd030fc7e tempest-VolumesActionsTest-1515172499 tempest-VolumesActionsTest-1515172499-project] [instance: 6d4e660b-2f36-40f0-9d87-14b6146eb533] Fetching instance by UUID {{(pid=102149) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:32:29.354470 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-6a2d4e62-40e6-4325-8443-727dd030fc7e tempest-VolumesActionsTest-1515172499 tempest-VolumesActionsTest-1515172499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dd95251dce947f8bb6a2739a6557dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fd35a8f65244b5a18f841af49d5c7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:32:29.381715 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-6a2d4e62-40e6-4325-8443-727dd030fc7e tempest-VolumesActionsTest-1515172499 tempest-VolumesActionsTest-1515172499-project] 10.222.0.18 "GET /compute/v2.1/servers/6d4e660b-2f36-40f0-9d87-14b6146eb533" status: 200 len: 1214 microversion: 2.1 time: 0.449193 Jun 24 16:32:29.395387 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 37/89] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:32:28 2022] GET /compute/v2.1/servers/6d4e660b-2f36-40f0-9d87-14b6146eb533 => generated 1214 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 16:32:29.635920 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-fb8a61e2-8509-4611-86ad-a97afb04d6bb tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c286a3f03048689e5ec552bb89c161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09584de3a4b14c5a90eb9b1c2149d6fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:32:29.638433 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [req-bc2b8a9e-6f7e-4349-b604-d9c2463661bb req-8332ae61-0abf-4167-a91c-33b92e835d06 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2fa4f019-3cbd-4b41-a0fc-6513f46474c0", "name": "network-vif-plugged", "status": "completed", "tag": "fc075890-b996-4078-bc3c-b93d621d7267"}]} {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 16:32:29.648254 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 24 16:32:29.648254 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: warnings.warn(msg) Jun 24 16:32:29.669288 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [req-bc2b8a9e-6f7e-4349-b604-d9c2463661bb req-8332ae61-0abf-4167-a91c-33b92e835d06 service nova] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:32:29.670884 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [req-bc2b8a9e-6f7e-4349-b604-d9c2463661bb req-8332ae61-0abf-4167-a91c-33b92e835d06 service nova] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:32:29.671155 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-fb8a61e2-8509-4611-86ad-a97afb04d6bb tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] 10.222.0.18 "GET /compute/v2.1/servers/1c690e22-ec9b-423d-9f32-e01ffb3fa4b1" status: 200 len: 1515 microversion: 2.1 time: 0.767416 Jun 24 16:32:29.688226 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 53/90] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:32:28 2022] GET /compute/v2.1/servers/1c690e22-ec9b-423d-9f32-e01ffb3fa4b1 => generated 1515 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 16:32:29.713827 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-b46ae81d-034c-4402-8ab4-034269737874 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 16:32:29.716857 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-b46ae81d-034c-4402-8ab4-034269737874 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] [instance: 1c690e22-ec9b-423d-9f32-e01ffb3fa4b1] Fetching instance by UUID {{(pid=102148) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:32:29.733684 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-b46ae81d-034c-4402-8ab4-034269737874 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:32:29.734723 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-b46ae81d-034c-4402-8ab4-034269737874 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:32:29.736367 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-b46ae81d-034c-4402-8ab4-034269737874 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:32:29.737479 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-b46ae81d-034c-4402-8ab4-034269737874 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:32:29.756342 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.compute.server_external_events [req-bc2b8a9e-6f7e-4349-b604-d9c2463661bb req-8332ae61-0abf-4167-a91c-33b92e835d06 service nova] Creating event network-vif-plugged:fc075890-b996-4078-bc3c-b93d621d7267 for instance 2fa4f019-3cbd-4b41-a0fc-6513f46474c0 on hv-cinder-84718 Jun 24 16:32:29.781890 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [req-bc2b8a9e-6f7e-4349-b604-d9c2463661bb req-8332ae61-0abf-4167-a91c-33b92e835d06 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.150898 Jun 24 16:32:29.783375 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 38/91] 10.222.0.18 () {64 vars in 1317 bytes} [Fri Jun 24 16:32:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 16:32:29.915605 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-dcedadbb-cf8b-46e2-87d4-f8772f2a47aa tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Calling method '>' {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:32:29.928629 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-dcedadbb-cf8b-46e2-87d4-f8772f2a47aa tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] [instance: 2fa4f019-3cbd-4b41-a0fc-6513f46474c0] Fetching instance by UUID {{(pid=102149) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:32:29.962064 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.objects.instance [None req-b46ae81d-034c-4402-8ab4-034269737874 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lazy-loading 'flavor' on Instance uuid 1c690e22-ec9b-423d-9f32-e01ffb3fa4b1 {{(pid=102148) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Jun 24 16:32:29.974498 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-dcedadbb-cf8b-46e2-87d4-f8772f2a47aa tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:32:29.975332 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-dcedadbb-cf8b-46e2-87d4-f8772f2a47aa tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:32:29.986259 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-dcedadbb-cf8b-46e2-87d4-f8772f2a47aa tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:32:29.988640 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-dcedadbb-cf8b-46e2-87d4-f8772f2a47aa tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:32:30.345417 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-b46ae81d-034c-4402-8ab4-034269737874 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] 10.222.0.18 "POST /compute/v2.1/servers/1c690e22-ec9b-423d-9f32-e01ffb3fa4b1/action" status: 200 len: 32 microversion: 2.1 time: 0.645142 Jun 24 16:32:30.347806 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 54/92] 10.222.0.18 () {60 vars in 1277 bytes} [Fri Jun 24 16:32:29 2022] POST /compute/v2.1/servers/1c690e22-ec9b-423d-9f32-e01ffb3fa4b1/action => generated 32 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 24 16:32:30.377523 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-34b75686-b125-4288-8810-267fa53870f3 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Calling method '>' {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:32:30.380349 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-34b75686-b125-4288-8810-267fa53870f3 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] [instance: 1c690e22-ec9b-423d-9f32-e01ffb3fa4b1] Fetching instance by UUID {{(pid=102148) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:32:30.411282 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-34b75686-b125-4288-8810-267fa53870f3 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:32:30.416210 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-34b75686-b125-4288-8810-267fa53870f3 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:32:30.417665 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-34b75686-b125-4288-8810-267fa53870f3 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:32:30.418256 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-34b75686-b125-4288-8810-267fa53870f3 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:32:31.033814 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-dcedadbb-cf8b-46e2-87d4-f8772f2a47aa tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '499faf87cf8c41ae823b2566e4c2d8ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606ba814a2d8408ab0856d539ca79b4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:32:31.068686 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-34b75686-b125-4288-8810-267fa53870f3 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c286a3f03048689e5ec552bb89c161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09584de3a4b14c5a90eb9b1c2149d6fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:32:31.077185 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-dcedadbb-cf8b-46e2-87d4-f8772f2a47aa tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] 10.222.0.18 "GET /compute/v2.1/servers/2fa4f019-3cbd-4b41-a0fc-6513f46474c0" status: 200 len: 1366 microversion: 2.1 time: 1.168761 Jun 24 16:32:31.077567 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 39/93] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:32:29 2022] GET /compute/v2.1/servers/2fa4f019-3cbd-4b41-a0fc-6513f46474c0 => generated 1366 bytes in 1173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 16:32:31.090302 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-34b75686-b125-4288-8810-267fa53870f3 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] 10.222.0.18 "GET /compute/v2.1/servers/1c690e22-ec9b-423d-9f32-e01ffb3fa4b1" status: 200 len: 1521 microversion: 2.1 time: 0.726374 Jun 24 16:32:31.090302 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 55/94] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:32:30 2022] GET /compute/v2.1/servers/1c690e22-ec9b-423d-9f32-e01ffb3fa4b1 => generated 1521 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 16:32:31.090797 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-9320f817-a51b-4e40-9f80-c745b07ea204 tempest-VolumesActionsTest-1515172499 tempest-VolumesActionsTest-1515172499-project] Calling method '>' {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:32:31.090797 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-9320f817-a51b-4e40-9f80-c745b07ea204 tempest-VolumesActionsTest-1515172499 tempest-VolumesActionsTest-1515172499-project] [instance: 6d4e660b-2f36-40f0-9d87-14b6146eb533] Fetching instance by UUID {{(pid=102149) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:32:31.093685 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-f9ffe74e-b328-4603-aba2-d5884fb80171 tempest-DeleteServersTestJSON-368419735 tempest-DeleteServersTestJSON-368419735-project] Calling method '>' {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:32:31.094359 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-f9ffe74e-b328-4603-aba2-d5884fb80171 tempest-DeleteServersTestJSON-368419735 tempest-DeleteServersTestJSON-368419735-project] [instance: 618dfcb0-fc23-4985-a7e0-9ec51837519b] Fetching instance by UUID {{(pid=102148) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:32:31.112896 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-f9ffe74e-b328-4603-aba2-d5884fb80171 tempest-DeleteServersTestJSON-368419735 tempest-DeleteServersTestJSON-368419735-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:32:31.113385 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-f9ffe74e-b328-4603-aba2-d5884fb80171 tempest-DeleteServersTestJSON-368419735 tempest-DeleteServersTestJSON-368419735-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:32:31.113830 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-f9ffe74e-b328-4603-aba2-d5884fb80171 tempest-DeleteServersTestJSON-368419735 tempest-DeleteServersTestJSON-368419735-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:32:31.114273 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-f9ffe74e-b328-4603-aba2-d5884fb80171 tempest-DeleteServersTestJSON-368419735 tempest-DeleteServersTestJSON-368419735-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:32:31.115874 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-9320f817-a51b-4e40-9f80-c745b07ea204 tempest-VolumesActionsTest-1515172499 tempest-VolumesActionsTest-1515172499-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:32:31.116318 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-9320f817-a51b-4e40-9f80-c745b07ea204 tempest-VolumesActionsTest-1515172499 tempest-VolumesActionsTest-1515172499-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:32:31.117092 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-9320f817-a51b-4e40-9f80-c745b07ea204 tempest-VolumesActionsTest-1515172499 tempest-VolumesActionsTest-1515172499-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:32:31.119720 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-9320f817-a51b-4e40-9f80-c745b07ea204 tempest-VolumesActionsTest-1515172499 tempest-VolumesActionsTest-1515172499-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:32:31.280271 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-f9ffe74e-b328-4603-aba2-d5884fb80171 tempest-DeleteServersTestJSON-368419735 tempest-DeleteServersTestJSON-368419735-project] [instance: 618dfcb0-fc23-4985-a7e0-9ec51837519b] Going to try to terminate instance {{(pid=102148) delete /opt/stack/nova/nova/compute/api.py:2562}} Jun 24 16:32:31.510986 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-f9ffe74e-b328-4603-aba2-d5884fb80171 tempest-DeleteServersTestJSON-368419735 tempest-DeleteServersTestJSON-368419735-project] 10.222.0.18 "DELETE /compute/v2.1/servers/618dfcb0-fc23-4985-a7e0-9ec51837519b" status: 204 len: 0 microversion: 2.1 time: 0.428180 Jun 24 16:32:31.516529 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 56/95] 10.222.0.18 () {58 vars in 1238 bytes} [Fri Jun 24 16:32:31 2022] DELETE /compute/v2.1/servers/618dfcb0-fc23-4985-a7e0-9ec51837519b => generated 0 bytes in 430 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 24 16:32:31.525266 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-084dbd8f-4d43-487d-95ce-e65e30615671 tempest-DeleteServersTestJSON-368419735 tempest-DeleteServersTestJSON-368419735-project] Calling method '>' {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:32:31.526076 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-084dbd8f-4d43-487d-95ce-e65e30615671 tempest-DeleteServersTestJSON-368419735 tempest-DeleteServersTestJSON-368419735-project] [instance: 618dfcb0-fc23-4985-a7e0-9ec51837519b] Fetching instance by UUID {{(pid=102148) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:32:31.535491 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-084dbd8f-4d43-487d-95ce-e65e30615671 tempest-DeleteServersTestJSON-368419735 tempest-DeleteServersTestJSON-368419735-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:32:31.536004 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-084dbd8f-4d43-487d-95ce-e65e30615671 tempest-DeleteServersTestJSON-368419735 tempest-DeleteServersTestJSON-368419735-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:32:31.537226 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-084dbd8f-4d43-487d-95ce-e65e30615671 tempest-DeleteServersTestJSON-368419735 tempest-DeleteServersTestJSON-368419735-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:32:31.537678 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-084dbd8f-4d43-487d-95ce-e65e30615671 tempest-DeleteServersTestJSON-368419735 tempest-DeleteServersTestJSON-368419735-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:32:31.552566 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-9320f817-a51b-4e40-9f80-c745b07ea204 tempest-VolumesActionsTest-1515172499 tempest-VolumesActionsTest-1515172499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dd95251dce947f8bb6a2739a6557dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fd35a8f65244b5a18f841af49d5c7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:32:31.568011 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-9320f817-a51b-4e40-9f80-c745b07ea204 tempest-VolumesActionsTest-1515172499 tempest-VolumesActionsTest-1515172499-project] 10.222.0.18 "GET /compute/v2.1/servers/6d4e660b-2f36-40f0-9d87-14b6146eb533" status: 200 len: 1218 microversion: 2.1 time: 0.489002 Jun 24 16:32:31.569229 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 40/96] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:32:31 2022] GET /compute/v2.1/servers/6d4e660b-2f36-40f0-9d87-14b6146eb533 => generated 1218 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 16:32:31.852200 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-084dbd8f-4d43-487d-95ce-e65e30615671 tempest-DeleteServersTestJSON-368419735 tempest-DeleteServersTestJSON-368419735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81eaf76db05e41feb86cb793787bdeac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '166c04f72691440d883f2508cc22df58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:32:31.867575 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-084dbd8f-4d43-487d-95ce-e65e30615671 tempest-DeleteServersTestJSON-368419735 tempest-DeleteServersTestJSON-368419735-project] 10.222.0.18 "GET /compute/v2.1/servers/618dfcb0-fc23-4985-a7e0-9ec51837519b" status: 200 len: 1553 microversion: 2.1 time: 0.349264 Jun 24 16:32:31.868645 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 57/97] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:32:31 2022] GET /compute/v2.1/servers/618dfcb0-fc23-4985-a7e0-9ec51837519b => generated 1553 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 16:32:32.115807 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-047ca327-bc68-476b-964f-14214fcbbe81 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Calling method '>' {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:32:32.116585 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-047ca327-bc68-476b-964f-14214fcbbe81 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] [instance: 2fa4f019-3cbd-4b41-a0fc-6513f46474c0] Fetching instance by UUID {{(pid=102149) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:32:32.125492 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-047ca327-bc68-476b-964f-14214fcbbe81 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:32:32.126236 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-047ca327-bc68-476b-964f-14214fcbbe81 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:32:32.127333 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-047ca327-bc68-476b-964f-14214fcbbe81 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:32:32.128517 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-047ca327-bc68-476b-964f-14214fcbbe81 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:32:32.133597 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-97152a80-dc45-4a04-9ca1-f52041c36a3f tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Calling method '>' {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:32:32.136562 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-97152a80-dc45-4a04-9ca1-f52041c36a3f tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] [instance: 1c690e22-ec9b-423d-9f32-e01ffb3fa4b1] Fetching instance by UUID {{(pid=102148) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:32:32.153045 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-97152a80-dc45-4a04-9ca1-f52041c36a3f tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:32:32.154151 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-97152a80-dc45-4a04-9ca1-f52041c36a3f tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:32:32.156562 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-97152a80-dc45-4a04-9ca1-f52041c36a3f tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:32:32.157556 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-97152a80-dc45-4a04-9ca1-f52041c36a3f tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:32:32.511192 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-047ca327-bc68-476b-964f-14214fcbbe81 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '499faf87cf8c41ae823b2566e4c2d8ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606ba814a2d8408ab0856d539ca79b4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:32:32.511192 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-047ca327-bc68-476b-964f-14214fcbbe81 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] 10.222.0.18 "GET /compute/v2.1/servers/2fa4f019-3cbd-4b41-a0fc-6513f46474c0" status: 200 len: 1366 microversion: 2.1 time: 0.399781 Jun 24 16:32:32.520670 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 41/98] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:32:32 2022] GET /compute/v2.1/servers/2fa4f019-3cbd-4b41-a0fc-6513f46474c0 => generated 1366 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 16:32:32.566960 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [req-7c45a0bf-e98c-48be-a359-4e9573da33b5 req-83ff36ab-d9bd-46bf-b6a9-e39828a2c25d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "30b3ffec-7110-4b4d-9482-2451914c166f", "tag": "78a4e31b-a598-4436-bdeb-0904cefd7b6e"}]} {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 16:32:32.571785 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 24 16:32:32.571785 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: warnings.warn(msg) Jun 24 16:32:32.597203 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [req-7c45a0bf-e98c-48be-a359-4e9573da33b5 req-83ff36ab-d9bd-46bf-b6a9-e39828a2c25d service nova] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:32:32.598283 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [req-7c45a0bf-e98c-48be-a359-4e9573da33b5 req-83ff36ab-d9bd-46bf-b6a9-e39828a2c25d service nova] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:32:32.636864 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.compute.server_external_events [req-7c45a0bf-e98c-48be-a359-4e9573da33b5 req-83ff36ab-d9bd-46bf-b6a9-e39828a2c25d service nova] Creating event network-changed:78a4e31b-a598-4436-bdeb-0904cefd7b6e for instance 30b3ffec-7110-4b4d-9482-2451914c166f on hv-cinder-84718 Jun 24 16:32:32.642859 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-97152a80-dc45-4a04-9ca1-f52041c36a3f tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c286a3f03048689e5ec552bb89c161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09584de3a4b14c5a90eb9b1c2149d6fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:32:32.649999 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [req-7c45a0bf-e98c-48be-a359-4e9573da33b5 req-83ff36ab-d9bd-46bf-b6a9-e39828a2c25d service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092663 Jun 24 16:32:32.652173 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 42/99] 10.222.0.18 () {64 vars in 1317 bytes} [Fri Jun 24 16:32:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 16:32:32.663279 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-5a8b8020-5115-44a4-bb98-6eebb7159d66 tempest-VolumesActionsTest-1515172499 tempest-VolumesActionsTest-1515172499-project] Calling method '>' {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:32:32.664912 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-5a8b8020-5115-44a4-bb98-6eebb7159d66 tempest-VolumesActionsTest-1515172499 tempest-VolumesActionsTest-1515172499-project] [instance: 6d4e660b-2f36-40f0-9d87-14b6146eb533] Fetching instance by UUID {{(pid=102149) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:32:32.665584 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-97152a80-dc45-4a04-9ca1-f52041c36a3f tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] 10.222.0.18 "GET /compute/v2.1/servers/1c690e22-ec9b-423d-9f32-e01ffb3fa4b1" status: 200 len: 1521 microversion: 2.1 time: 0.540321 Jun 24 16:32:32.682849 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 58/100] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:32:32 2022] GET /compute/v2.1/servers/1c690e22-ec9b-423d-9f32-e01ffb3fa4b1 => generated 1521 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 16:32:32.683154 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-5a8b8020-5115-44a4-bb98-6eebb7159d66 tempest-VolumesActionsTest-1515172499 tempest-VolumesActionsTest-1515172499-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:32:32.684323 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-5a8b8020-5115-44a4-bb98-6eebb7159d66 tempest-VolumesActionsTest-1515172499 tempest-VolumesActionsTest-1515172499-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:32:32.685839 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-5a8b8020-5115-44a4-bb98-6eebb7159d66 tempest-VolumesActionsTest-1515172499 tempest-VolumesActionsTest-1515172499-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:32:32.686930 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-5a8b8020-5115-44a4-bb98-6eebb7159d66 tempest-VolumesActionsTest-1515172499 tempest-VolumesActionsTest-1515172499-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:32:32.899063 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-95cc0a9a-59e8-47f4-856b-0216fb3d5284 tempest-DeleteServersTestJSON-368419735 tempest-DeleteServersTestJSON-368419735-project] Calling method '>' {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:32:32.900155 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-95cc0a9a-59e8-47f4-856b-0216fb3d5284 tempest-DeleteServersTestJSON-368419735 tempest-DeleteServersTestJSON-368419735-project] [instance: 618dfcb0-fc23-4985-a7e0-9ec51837519b] Fetching instance by UUID {{(pid=102148) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:32:32.901940 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-5a8b8020-5115-44a4-bb98-6eebb7159d66 tempest-VolumesActionsTest-1515172499 tempest-VolumesActionsTest-1515172499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dd95251dce947f8bb6a2739a6557dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fd35a8f65244b5a18f841af49d5c7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:32:32.912848 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-5a8b8020-5115-44a4-bb98-6eebb7159d66 tempest-VolumesActionsTest-1515172499 tempest-VolumesActionsTest-1515172499-project] 10.222.0.18 "GET /compute/v2.1/servers/6d4e660b-2f36-40f0-9d87-14b6146eb533" status: 200 len: 1218 microversion: 2.1 time: 0.257206 Jun 24 16:32:32.913970 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 43/101] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:32:32 2022] GET /compute/v2.1/servers/6d4e660b-2f36-40f0-9d87-14b6146eb533 => generated 1218 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 16:32:32.914522 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-95cc0a9a-59e8-47f4-856b-0216fb3d5284 tempest-DeleteServersTestJSON-368419735 tempest-DeleteServersTestJSON-368419735-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:32:32.915391 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-95cc0a9a-59e8-47f4-856b-0216fb3d5284 tempest-DeleteServersTestJSON-368419735 tempest-DeleteServersTestJSON-368419735-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:32:32.916918 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-95cc0a9a-59e8-47f4-856b-0216fb3d5284 tempest-DeleteServersTestJSON-368419735 tempest-DeleteServersTestJSON-368419735-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:32:32.921015 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-95cc0a9a-59e8-47f4-856b-0216fb3d5284 tempest-DeleteServersTestJSON-368419735 tempest-DeleteServersTestJSON-368419735-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:32:33.232459 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-95cc0a9a-59e8-47f4-856b-0216fb3d5284 tempest-DeleteServersTestJSON-368419735 tempest-DeleteServersTestJSON-368419735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81eaf76db05e41feb86cb793787bdeac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '166c04f72691440d883f2508cc22df58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:32:33.248671 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-95cc0a9a-59e8-47f4-856b-0216fb3d5284 tempest-DeleteServersTestJSON-368419735 tempest-DeleteServersTestJSON-368419735-project] 10.222.0.18 "GET /compute/v2.1/servers/618dfcb0-fc23-4985-a7e0-9ec51837519b" status: 200 len: 1553 microversion: 2.1 time: 0.358461 Jun 24 16:32:33.251935 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 59/102] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:32:32 2022] GET /compute/v2.1/servers/618dfcb0-fc23-4985-a7e0-9ec51837519b => generated 1553 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 16:32:33.528578 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-e05d194c-233b-4cdf-8d59-048fe26aee81 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Calling method '>' {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:32:33.529779 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-e05d194c-233b-4cdf-8d59-048fe26aee81 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] [instance: 2fa4f019-3cbd-4b41-a0fc-6513f46474c0] Fetching instance by UUID {{(pid=102149) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:32:33.550391 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-e05d194c-233b-4cdf-8d59-048fe26aee81 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:32:33.555480 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-e05d194c-233b-4cdf-8d59-048fe26aee81 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:32:33.556653 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-e05d194c-233b-4cdf-8d59-048fe26aee81 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:32:33.557474 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-e05d194c-233b-4cdf-8d59-048fe26aee81 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:32:33.700666 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-5a9ea708-806e-40dd-a77d-a41297aef18f tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Calling method '>' {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:32:33.703154 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-5a9ea708-806e-40dd-a77d-a41297aef18f tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] [instance: 1c690e22-ec9b-423d-9f32-e01ffb3fa4b1] Fetching instance by UUID {{(pid=102148) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:32:33.760863 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-5a9ea708-806e-40dd-a77d-a41297aef18f tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:32:33.761379 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-5a9ea708-806e-40dd-a77d-a41297aef18f tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:32:33.772351 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-5a9ea708-806e-40dd-a77d-a41297aef18f tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:32:33.774497 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-5a9ea708-806e-40dd-a77d-a41297aef18f tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:32:34.464896 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-e05d194c-233b-4cdf-8d59-048fe26aee81 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '499faf87cf8c41ae823b2566e4c2d8ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606ba814a2d8408ab0856d539ca79b4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:32:34.478601 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-e05d194c-233b-4cdf-8d59-048fe26aee81 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] 10.222.0.18 "GET /compute/v2.1/servers/2fa4f019-3cbd-4b41-a0fc-6513f46474c0" status: 200 len: 1366 microversion: 2.1 time: 0.951026 Jun 24 16:32:34.479687 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 44/103] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:32:33 2022] GET /compute/v2.1/servers/2fa4f019-3cbd-4b41-a0fc-6513f46474c0 => generated 1366 bytes in 955 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 16:32:34.489860 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-474ebc42-82d5-4b7c-84bf-349fd8f13409 tempest-VolumesActionsTest-1515172499 tempest-VolumesActionsTest-1515172499-project] Calling method '>' {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:32:34.491837 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-474ebc42-82d5-4b7c-84bf-349fd8f13409 tempest-VolumesActionsTest-1515172499 tempest-VolumesActionsTest-1515172499-project] [instance: 6d4e660b-2f36-40f0-9d87-14b6146eb533] Fetching instance by UUID {{(pid=102149) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:32:34.506902 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-5a9ea708-806e-40dd-a77d-a41297aef18f tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c286a3f03048689e5ec552bb89c161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09584de3a4b14c5a90eb9b1c2149d6fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:32:34.517762 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-5a9ea708-806e-40dd-a77d-a41297aef18f tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] 10.222.0.18 "GET /compute/v2.1/servers/1c690e22-ec9b-423d-9f32-e01ffb3fa4b1" status: 200 len: 1521 microversion: 2.1 time: 0.824940 Jun 24 16:32:34.530464 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-474ebc42-82d5-4b7c-84bf-349fd8f13409 tempest-VolumesActionsTest-1515172499 tempest-VolumesActionsTest-1515172499-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:32:34.530464 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-474ebc42-82d5-4b7c-84bf-349fd8f13409 tempest-VolumesActionsTest-1515172499 tempest-VolumesActionsTest-1515172499-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:32:34.531482 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 60/104] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:32:33 2022] GET /compute/v2.1/servers/1c690e22-ec9b-423d-9f32-e01ffb3fa4b1 => generated 1521 bytes in 829 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 16:32:34.531617 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-474ebc42-82d5-4b7c-84bf-349fd8f13409 tempest-VolumesActionsTest-1515172499 tempest-VolumesActionsTest-1515172499-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:32:34.531617 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-474ebc42-82d5-4b7c-84bf-349fd8f13409 tempest-VolumesActionsTest-1515172499 tempest-VolumesActionsTest-1515172499-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:32:34.531874 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-e10e9162-9df6-41c6-8763-c98bebbfcbbb tempest-DeleteServersTestJSON-368419735 tempest-DeleteServersTestJSON-368419735-project] Calling method '>' {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:32:34.531874 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-e10e9162-9df6-41c6-8763-c98bebbfcbbb tempest-DeleteServersTestJSON-368419735 tempest-DeleteServersTestJSON-368419735-project] [instance: 618dfcb0-fc23-4985-a7e0-9ec51837519b] Fetching instance by UUID {{(pid=102148) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:32:34.548240 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-e10e9162-9df6-41c6-8763-c98bebbfcbbb tempest-DeleteServersTestJSON-368419735 tempest-DeleteServersTestJSON-368419735-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:32:34.549476 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-e10e9162-9df6-41c6-8763-c98bebbfcbbb tempest-DeleteServersTestJSON-368419735 tempest-DeleteServersTestJSON-368419735-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:32:34.550233 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-e10e9162-9df6-41c6-8763-c98bebbfcbbb tempest-DeleteServersTestJSON-368419735 tempest-DeleteServersTestJSON-368419735-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:32:34.554905 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-e10e9162-9df6-41c6-8763-c98bebbfcbbb tempest-DeleteServersTestJSON-368419735 tempest-DeleteServersTestJSON-368419735-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:32:34.923251 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-474ebc42-82d5-4b7c-84bf-349fd8f13409 tempest-VolumesActionsTest-1515172499 tempest-VolumesActionsTest-1515172499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dd95251dce947f8bb6a2739a6557dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fd35a8f65244b5a18f841af49d5c7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:32:34.947687 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-474ebc42-82d5-4b7c-84bf-349fd8f13409 tempest-VolumesActionsTest-1515172499 tempest-VolumesActionsTest-1515172499-project] 10.222.0.18 "GET /compute/v2.1/servers/6d4e660b-2f36-40f0-9d87-14b6146eb533" status: 200 len: 1266 microversion: 2.1 time: 0.464327 Jun 24 16:32:34.955126 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 45/105] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:32:34 2022] GET /compute/v2.1/servers/6d4e660b-2f36-40f0-9d87-14b6146eb533 => generated 1266 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 16:32:35.133551 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-e10e9162-9df6-41c6-8763-c98bebbfcbbb tempest-DeleteServersTestJSON-368419735 tempest-DeleteServersTestJSON-368419735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81eaf76db05e41feb86cb793787bdeac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '166c04f72691440d883f2508cc22df58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:32:35.152864 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-e10e9162-9df6-41c6-8763-c98bebbfcbbb tempest-DeleteServersTestJSON-368419735 tempest-DeleteServersTestJSON-368419735-project] 10.222.0.18 "GET /compute/v2.1/servers/618dfcb0-fc23-4985-a7e0-9ec51837519b" status: 200 len: 1553 microversion: 2.1 time: 0.630268 Jun 24 16:32:35.154501 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 61/106] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:32:34 2022] GET /compute/v2.1/servers/618dfcb0-fc23-4985-a7e0-9ec51837519b => generated 1553 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 16:32:35.503968 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-7233efa6-f152-4b3d-94e9-61a6f69f361e tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Calling method '>' {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:32:35.504552 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-7233efa6-f152-4b3d-94e9-61a6f69f361e tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] [instance: 2fa4f019-3cbd-4b41-a0fc-6513f46474c0] Fetching instance by UUID {{(pid=102149) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:32:35.521372 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-7233efa6-f152-4b3d-94e9-61a6f69f361e tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:32:35.521947 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-7233efa6-f152-4b3d-94e9-61a6f69f361e tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:32:35.522765 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-7233efa6-f152-4b3d-94e9-61a6f69f361e tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:32:35.523213 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-7233efa6-f152-4b3d-94e9-61a6f69f361e tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:32:35.548185 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-e79f445c-c264-4af0-8872-a631156468c5 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Calling method '>' {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:32:35.549097 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-e79f445c-c264-4af0-8872-a631156468c5 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] [instance: 1c690e22-ec9b-423d-9f32-e01ffb3fa4b1] Fetching instance by UUID {{(pid=102148) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:32:35.573265 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-e79f445c-c264-4af0-8872-a631156468c5 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:32:35.573965 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-e79f445c-c264-4af0-8872-a631156468c5 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:32:35.575369 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-e79f445c-c264-4af0-8872-a631156468c5 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:32:35.575944 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-e79f445c-c264-4af0-8872-a631156468c5 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:32:36.366525 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-7233efa6-f152-4b3d-94e9-61a6f69f361e tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '499faf87cf8c41ae823b2566e4c2d8ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606ba814a2d8408ab0856d539ca79b4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:32:36.400614 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-7233efa6-f152-4b3d-94e9-61a6f69f361e tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] 10.222.0.18 "GET /compute/v2.1/servers/2fa4f019-3cbd-4b41-a0fc-6513f46474c0" status: 200 len: 1366 microversion: 2.1 time: 0.887111 Jun 24 16:32:36.402042 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 46/107] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:32:35 2022] GET /compute/v2.1/servers/2fa4f019-3cbd-4b41-a0fc-6513f46474c0 => generated 1366 bytes in 903 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 16:32:36.444306 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-dcb34a06-1f7e-4b91-86bc-50c28ee584f5 tempest-VolumesActionsTest-1515172499 tempest-VolumesActionsTest-1515172499-project] Calling method '>' {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:32:36.451027 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-dcb34a06-1f7e-4b91-86bc-50c28ee584f5 tempest-VolumesActionsTest-1515172499 tempest-VolumesActionsTest-1515172499-project] [instance: 6d4e660b-2f36-40f0-9d87-14b6146eb533] Fetching instance by UUID {{(pid=102149) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:32:36.500287 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-dcb34a06-1f7e-4b91-86bc-50c28ee584f5 tempest-VolumesActionsTest-1515172499 tempest-VolumesActionsTest-1515172499-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:32:36.503234 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-dcb34a06-1f7e-4b91-86bc-50c28ee584f5 tempest-VolumesActionsTest-1515172499 tempest-VolumesActionsTest-1515172499-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:32:36.506054 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-dcb34a06-1f7e-4b91-86bc-50c28ee584f5 tempest-VolumesActionsTest-1515172499 tempest-VolumesActionsTest-1515172499-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:32:36.511043 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-dcb34a06-1f7e-4b91-86bc-50c28ee584f5 tempest-VolumesActionsTest-1515172499 tempest-VolumesActionsTest-1515172499-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:32:36.582597 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-e79f445c-c264-4af0-8872-a631156468c5 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c286a3f03048689e5ec552bb89c161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09584de3a4b14c5a90eb9b1c2149d6fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:32:36.596872 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-e79f445c-c264-4af0-8872-a631156468c5 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] 10.222.0.18 "GET /compute/v2.1/servers/1c690e22-ec9b-423d-9f32-e01ffb3fa4b1" status: 200 len: 1521 microversion: 2.1 time: 1.051961 Jun 24 16:32:36.621989 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 62/108] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:32:35 2022] GET /compute/v2.1/servers/1c690e22-ec9b-423d-9f32-e01ffb3fa4b1 => generated 1521 bytes in 1078 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 16:32:36.639677 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-87d187f4-b0b4-46a4-bb52-0ef4492202e1 tempest-DeleteServersTestJSON-368419735 tempest-DeleteServersTestJSON-368419735-project] Calling method '>' {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:32:36.640158 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-87d187f4-b0b4-46a4-bb52-0ef4492202e1 tempest-DeleteServersTestJSON-368419735 tempest-DeleteServersTestJSON-368419735-project] [instance: 618dfcb0-fc23-4985-a7e0-9ec51837519b] Fetching instance by UUID {{(pid=102148) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:32:36.654662 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-87d187f4-b0b4-46a4-bb52-0ef4492202e1 tempest-DeleteServersTestJSON-368419735 tempest-DeleteServersTestJSON-368419735-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:32:36.655906 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-87d187f4-b0b4-46a4-bb52-0ef4492202e1 tempest-DeleteServersTestJSON-368419735 tempest-DeleteServersTestJSON-368419735-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:32:36.657569 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-87d187f4-b0b4-46a4-bb52-0ef4492202e1 tempest-DeleteServersTestJSON-368419735 tempest-DeleteServersTestJSON-368419735-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:32:36.659654 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-87d187f4-b0b4-46a4-bb52-0ef4492202e1 tempest-DeleteServersTestJSON-368419735 tempest-DeleteServersTestJSON-368419735-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:32:36.760970 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-dcb34a06-1f7e-4b91-86bc-50c28ee584f5 tempest-VolumesActionsTest-1515172499 tempest-VolumesActionsTest-1515172499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dd95251dce947f8bb6a2739a6557dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fd35a8f65244b5a18f841af49d5c7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:32:36.808429 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-dcb34a06-1f7e-4b91-86bc-50c28ee584f5 tempest-VolumesActionsTest-1515172499 tempest-VolumesActionsTest-1515172499-project] 10.222.0.18 "GET /compute/v2.1/servers/6d4e660b-2f36-40f0-9d87-14b6146eb533" status: 200 len: 1272 microversion: 2.1 time: 0.369714 Jun 24 16:32:36.809933 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 47/109] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:32:36 2022] GET /compute/v2.1/servers/6d4e660b-2f36-40f0-9d87-14b6146eb533 => generated 1272 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 16:32:37.434654 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-6d891edc-4a20-4d27-92dd-6f36045a454d tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Calling method '>' {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:32:37.435945 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-6d891edc-4a20-4d27-92dd-6f36045a454d tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] [instance: 2fa4f019-3cbd-4b41-a0fc-6513f46474c0] Fetching instance by UUID {{(pid=102149) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:32:37.450371 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-6d891edc-4a20-4d27-92dd-6f36045a454d tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:32:37.451092 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-6d891edc-4a20-4d27-92dd-6f36045a454d tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:32:37.452127 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-6d891edc-4a20-4d27-92dd-6f36045a454d tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:32:37.452773 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-6d891edc-4a20-4d27-92dd-6f36045a454d tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:32:37.485265 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-87d187f4-b0b4-46a4-bb52-0ef4492202e1 tempest-DeleteServersTestJSON-368419735 tempest-DeleteServersTestJSON-368419735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81eaf76db05e41feb86cb793787bdeac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '166c04f72691440d883f2508cc22df58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:32:37.506032 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-87d187f4-b0b4-46a4-bb52-0ef4492202e1 tempest-DeleteServersTestJSON-368419735 tempest-DeleteServersTestJSON-368419735-project] 10.222.0.18 "GET /compute/v2.1/servers/618dfcb0-fc23-4985-a7e0-9ec51837519b" status: 200 len: 1553 microversion: 2.1 time: 0.882055 Jun 24 16:32:37.519241 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 63/110] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:32:36 2022] GET /compute/v2.1/servers/618dfcb0-fc23-4985-a7e0-9ec51837519b => generated 1553 bytes in 896 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 16:32:37.616418 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-f52ba1a3-d6ac-4211-a940-e16eb7abdf67 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Calling method '>' {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:32:37.617779 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-f52ba1a3-d6ac-4211-a940-e16eb7abdf67 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] [instance: 1c690e22-ec9b-423d-9f32-e01ffb3fa4b1] Fetching instance by UUID {{(pid=102148) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:32:37.626749 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-f52ba1a3-d6ac-4211-a940-e16eb7abdf67 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:32:37.627276 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-f52ba1a3-d6ac-4211-a940-e16eb7abdf67 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:32:37.628449 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-f52ba1a3-d6ac-4211-a940-e16eb7abdf67 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:32:37.628960 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-f52ba1a3-d6ac-4211-a940-e16eb7abdf67 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:32:38.160309 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-6d891edc-4a20-4d27-92dd-6f36045a454d tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '499faf87cf8c41ae823b2566e4c2d8ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606ba814a2d8408ab0856d539ca79b4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:32:38.175295 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-6d891edc-4a20-4d27-92dd-6f36045a454d tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] 10.222.0.18 "GET /compute/v2.1/servers/2fa4f019-3cbd-4b41-a0fc-6513f46474c0" status: 200 len: 1557 microversion: 2.1 time: 0.746487 Jun 24 16:32:38.196212 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 48/111] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:32:37 2022] GET /compute/v2.1/servers/2fa4f019-3cbd-4b41-a0fc-6513f46474c0 => generated 1557 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 16:32:38.206233 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-99083e5f-ddf3-47b7-acb2-a648c2af3811 tempest-VolumesActionsTest-1515172499 tempest-VolumesActionsTest-1515172499-project] Calling method '>' {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:32:38.207588 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-99083e5f-ddf3-47b7-acb2-a648c2af3811 tempest-VolumesActionsTest-1515172499 tempest-VolumesActionsTest-1515172499-project] [instance: 6d4e660b-2f36-40f0-9d87-14b6146eb533] Fetching instance by UUID {{(pid=102149) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:32:38.223210 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-99083e5f-ddf3-47b7-acb2-a648c2af3811 tempest-VolumesActionsTest-1515172499 tempest-VolumesActionsTest-1515172499-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:32:38.224433 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-99083e5f-ddf3-47b7-acb2-a648c2af3811 tempest-VolumesActionsTest-1515172499 tempest-VolumesActionsTest-1515172499-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:32:38.226772 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-99083e5f-ddf3-47b7-acb2-a648c2af3811 tempest-VolumesActionsTest-1515172499 tempest-VolumesActionsTest-1515172499-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:32:38.227656 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-99083e5f-ddf3-47b7-acb2-a648c2af3811 tempest-VolumesActionsTest-1515172499 tempest-VolumesActionsTest-1515172499-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:32:38.234704 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-f52ba1a3-d6ac-4211-a940-e16eb7abdf67 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c286a3f03048689e5ec552bb89c161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09584de3a4b14c5a90eb9b1c2149d6fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:32:38.263535 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-f52ba1a3-d6ac-4211-a940-e16eb7abdf67 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] 10.222.0.18 "GET /compute/v2.1/servers/1c690e22-ec9b-423d-9f32-e01ffb3fa4b1" status: 200 len: 1521 microversion: 2.1 time: 0.652765 Jun 24 16:32:38.277253 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 64/112] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:32:37 2022] GET /compute/v2.1/servers/1c690e22-ec9b-423d-9f32-e01ffb3fa4b1 => generated 1521 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 16:32:38.287964 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-2d700c7f-a127-497c-afab-d38a38384a3e tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Calling method '>' {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:32:38.288795 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-2d700c7f-a127-497c-afab-d38a38384a3e tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] [instance: 2fa4f019-3cbd-4b41-a0fc-6513f46474c0] Fetching instance by UUID {{(pid=102148) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:32:38.297761 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-2d700c7f-a127-497c-afab-d38a38384a3e tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:32:38.298570 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-2d700c7f-a127-497c-afab-d38a38384a3e tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:32:38.299716 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-2d700c7f-a127-497c-afab-d38a38384a3e tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:32:38.300361 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-2d700c7f-a127-497c-afab-d38a38384a3e tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:32:38.984918 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-2d700c7f-a127-497c-afab-d38a38384a3e tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] 10.222.0.18 "GET /compute/v2.1/servers/2fa4f019-3cbd-4b41-a0fc-6513f46474c0/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.705863 Jun 24 16:32:38.985865 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 65/113] 10.222.0.18 () {58 vars in 1274 bytes} [Fri Jun 24 16:32:38 2022] GET /compute/v2.1/servers/2fa4f019-3cbd-4b41-a0fc-6513f46474c0/os-interface => generated 285 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 16:32:38.993623 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-a4332012-b0a6-41e6-978a-c88fa49acde7 tempest-DeleteServersTestJSON-368419735 tempest-DeleteServersTestJSON-368419735-project] Calling method '>' {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:32:38.998943 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-a4332012-b0a6-41e6-978a-c88fa49acde7 tempest-DeleteServersTestJSON-368419735 tempest-DeleteServersTestJSON-368419735-project] [instance: 618dfcb0-fc23-4985-a7e0-9ec51837519b] Fetching instance by UUID {{(pid=102148) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:32:39.017075 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-a4332012-b0a6-41e6-978a-c88fa49acde7 tempest-DeleteServersTestJSON-368419735 tempest-DeleteServersTestJSON-368419735-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:32:39.017579 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-a4332012-b0a6-41e6-978a-c88fa49acde7 tempest-DeleteServersTestJSON-368419735 tempest-DeleteServersTestJSON-368419735-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:32:39.018440 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-a4332012-b0a6-41e6-978a-c88fa49acde7 tempest-DeleteServersTestJSON-368419735 tempest-DeleteServersTestJSON-368419735-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:32:39.019037 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-a4332012-b0a6-41e6-978a-c88fa49acde7 tempest-DeleteServersTestJSON-368419735 tempest-DeleteServersTestJSON-368419735-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:32:39.703771 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-a4332012-b0a6-41e6-978a-c88fa49acde7 tempest-DeleteServersTestJSON-368419735 tempest-DeleteServersTestJSON-368419735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81eaf76db05e41feb86cb793787bdeac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '166c04f72691440d883f2508cc22df58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:32:39.725949 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-a4332012-b0a6-41e6-978a-c88fa49acde7 tempest-DeleteServersTestJSON-368419735 tempest-DeleteServersTestJSON-368419735-project] 10.222.0.18 "GET /compute/v2.1/servers/618dfcb0-fc23-4985-a7e0-9ec51837519b" status: 200 len: 1511 microversion: 2.1 time: 0.738986 Jun 24 16:32:39.726937 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 66/114] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:32:38 2022] GET /compute/v2.1/servers/618dfcb0-fc23-4985-a7e0-9ec51837519b => generated 1511 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 16:32:39.736442 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-024950cc-e40e-4078-b5f9-31274885d167 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Calling method '>' {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:32:39.738047 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-024950cc-e40e-4078-b5f9-31274885d167 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] [instance: 1c690e22-ec9b-423d-9f32-e01ffb3fa4b1] Fetching instance by UUID {{(pid=102148) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:32:39.756055 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-024950cc-e40e-4078-b5f9-31274885d167 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:32:39.757208 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-024950cc-e40e-4078-b5f9-31274885d167 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:32:39.758471 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-024950cc-e40e-4078-b5f9-31274885d167 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:32:39.759443 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-024950cc-e40e-4078-b5f9-31274885d167 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:32:39.882277 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-99083e5f-ddf3-47b7-acb2-a648c2af3811 tempest-VolumesActionsTest-1515172499 tempest-VolumesActionsTest-1515172499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dd95251dce947f8bb6a2739a6557dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fd35a8f65244b5a18f841af49d5c7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:32:39.895308 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-99083e5f-ddf3-47b7-acb2-a648c2af3811 tempest-VolumesActionsTest-1515172499 tempest-VolumesActionsTest-1515172499-project] 10.222.0.18 "GET /compute/v2.1/servers/6d4e660b-2f36-40f0-9d87-14b6146eb533" status: 200 len: 1314 microversion: 2.1 time: 1.695334 Jun 24 16:32:39.895308 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 49/115] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:32:38 2022] GET /compute/v2.1/servers/6d4e660b-2f36-40f0-9d87-14b6146eb533 => generated 1314 bytes in 1697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 16:32:39.899895 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [req-041b9228-f8ab-4a96-83f1-9692c8c7bcec req-4bcb7cad-d041-4ed0-8c3b-bb7bd0a33e83 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "618dfcb0-fc23-4985-a7e0-9ec51837519b", "name": "network-vif-deleted", "tag": "01b6a726-f17e-4aa4-8491-1194120a4053"}]} {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 16:32:39.902166 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 24 16:32:39.902166 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: warnings.warn(msg) Jun 24 16:32:39.912885 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [req-041b9228-f8ab-4a96-83f1-9692c8c7bcec req-4bcb7cad-d041-4ed0-8c3b-bb7bd0a33e83 service nova] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:32:39.914958 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [req-041b9228-f8ab-4a96-83f1-9692c8c7bcec req-4bcb7cad-d041-4ed0-8c3b-bb7bd0a33e83 service nova] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:32:39.956297 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.compute.server_external_events [req-041b9228-f8ab-4a96-83f1-9692c8c7bcec req-4bcb7cad-d041-4ed0-8c3b-bb7bd0a33e83 service nova] Creating event network-vif-deleted:01b6a726-f17e-4aa4-8491-1194120a4053 for instance 618dfcb0-fc23-4985-a7e0-9ec51837519b on hv-cinder-84718 Jun 24 16:32:39.967448 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [req-041b9228-f8ab-4a96-83f1-9692c8c7bcec req-4bcb7cad-d041-4ed0-8c3b-bb7bd0a33e83 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068689 Jun 24 16:32:39.967448 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 50/116] 10.222.0.18 () {64 vars in 1317 bytes} [Fri Jun 24 16:32:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 16:32:40.748865 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-2116679d-a291-4863-ac60-e95c631d39d1 tempest-DeleteServersTestJSON-368419735 tempest-DeleteServersTestJSON-368419735-project] Calling method '>' {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:32:40.749916 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-2116679d-a291-4863-ac60-e95c631d39d1 tempest-DeleteServersTestJSON-368419735 tempest-DeleteServersTestJSON-368419735-project] [instance: 618dfcb0-fc23-4985-a7e0-9ec51837519b] Fetching instance by UUID {{(pid=102149) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:32:40.761807 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-2116679d-a291-4863-ac60-e95c631d39d1 tempest-DeleteServersTestJSON-368419735 tempest-DeleteServersTestJSON-368419735-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:32:40.762601 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-2116679d-a291-4863-ac60-e95c631d39d1 tempest-DeleteServersTestJSON-368419735 tempest-DeleteServersTestJSON-368419735-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:32:40.763635 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-2116679d-a291-4863-ac60-e95c631d39d1 tempest-DeleteServersTestJSON-368419735 tempest-DeleteServersTestJSON-368419735-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:32:40.764034 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-2116679d-a291-4863-ac60-e95c631d39d1 tempest-DeleteServersTestJSON-368419735 tempest-DeleteServersTestJSON-368419735-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:32:40.852096 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-024950cc-e40e-4078-b5f9-31274885d167 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c286a3f03048689e5ec552bb89c161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09584de3a4b14c5a90eb9b1c2149d6fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:32:40.866341 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-024950cc-e40e-4078-b5f9-31274885d167 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] 10.222.0.18 "GET /compute/v2.1/servers/1c690e22-ec9b-423d-9f32-e01ffb3fa4b1" status: 200 len: 1521 microversion: 2.1 time: 1.137895 Jun 24 16:32:40.867607 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-2116679d-a291-4863-ac60-e95c631d39d1 tempest-DeleteServersTestJSON-368419735 tempest-DeleteServersTestJSON-368419735-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:32:40.868177 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 67/117] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:32:39 2022] GET /compute/v2.1/servers/1c690e22-ec9b-423d-9f32-e01ffb3fa4b1 => generated 1521 bytes in 1141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 16:32:40.868558 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-2116679d-a291-4863-ac60-e95c631d39d1 tempest-DeleteServersTestJSON-368419735 tempest-DeleteServersTestJSON-368419735-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:32:40.869210 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.objects.instance [None req-2116679d-a291-4863-ac60-e95c631d39d1 tempest-DeleteServersTestJSON-368419735 tempest-DeleteServersTestJSON-368419735-project] Lazy-loading 'fault' on Instance uuid 618dfcb0-fc23-4985-a7e0-9ec51837519b {{(pid=102149) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Jun 24 16:32:40.928785 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-31e22a21-7b92-4d51-9091-045da400b273 tempest-VolumesActionsTest-1515172499 tempest-VolumesActionsTest-1515172499-project] Calling method '>' {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:32:40.930676 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-31e22a21-7b92-4d51-9091-045da400b273 tempest-VolumesActionsTest-1515172499 tempest-VolumesActionsTest-1515172499-project] [instance: 6d4e660b-2f36-40f0-9d87-14b6146eb533] Fetching instance by UUID {{(pid=102148) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:32:40.948208 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-31e22a21-7b92-4d51-9091-045da400b273 tempest-VolumesActionsTest-1515172499 tempest-VolumesActionsTest-1515172499-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:32:40.949989 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-31e22a21-7b92-4d51-9091-045da400b273 tempest-VolumesActionsTest-1515172499 tempest-VolumesActionsTest-1515172499-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:32:40.951746 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-31e22a21-7b92-4d51-9091-045da400b273 tempest-VolumesActionsTest-1515172499 tempest-VolumesActionsTest-1515172499-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:32:40.952890 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-31e22a21-7b92-4d51-9091-045da400b273 tempest-VolumesActionsTest-1515172499 tempest-VolumesActionsTest-1515172499-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:32:41.024732 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-2116679d-a291-4863-ac60-e95c631d39d1 tempest-DeleteServersTestJSON-368419735 tempest-DeleteServersTestJSON-368419735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81eaf76db05e41feb86cb793787bdeac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '166c04f72691440d883f2508cc22df58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:32:41.040487 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-2116679d-a291-4863-ac60-e95c631d39d1 tempest-DeleteServersTestJSON-368419735 tempest-DeleteServersTestJSON-368419735-project] 10.222.0.18 "GET /compute/v2.1/servers/618dfcb0-fc23-4985-a7e0-9ec51837519b" status: 200 len: 1350 microversion: 2.1 time: 0.298895 Jun 24 16:32:41.042833 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 51/118] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:32:40 2022] GET /compute/v2.1/servers/618dfcb0-fc23-4985-a7e0-9ec51837519b => generated 1350 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 16:32:41.893986 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-bac84d17-d5d7-41d4-a84d-25d079c009ee tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Calling method '>' {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:32:41.895061 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-bac84d17-d5d7-41d4-a84d-25d079c009ee tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] [instance: 1c690e22-ec9b-423d-9f32-e01ffb3fa4b1] Fetching instance by UUID {{(pid=102149) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:32:41.915121 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-bac84d17-d5d7-41d4-a84d-25d079c009ee tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:32:41.916224 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-bac84d17-d5d7-41d4-a84d-25d079c009ee tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:32:41.919229 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-bac84d17-d5d7-41d4-a84d-25d079c009ee tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:32:41.921365 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-bac84d17-d5d7-41d4-a84d-25d079c009ee tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:32:42.345004 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-31e22a21-7b92-4d51-9091-045da400b273 tempest-VolumesActionsTest-1515172499 tempest-VolumesActionsTest-1515172499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dd95251dce947f8bb6a2739a6557dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fd35a8f65244b5a18f841af49d5c7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:32:42.361415 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-31e22a21-7b92-4d51-9091-045da400b273 tempest-VolumesActionsTest-1515172499 tempest-VolumesActionsTest-1515172499-project] 10.222.0.18 "GET /compute/v2.1/servers/6d4e660b-2f36-40f0-9d87-14b6146eb533" status: 200 len: 1314 microversion: 2.1 time: 1.440754 Jun 24 16:32:42.368536 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 68/119] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:32:40 2022] GET /compute/v2.1/servers/6d4e660b-2f36-40f0-9d87-14b6146eb533 => generated 1314 bytes in 1450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 16:32:42.381351 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-e037e051-5f08-471b-9309-058a0d811644 tempest-DeleteServersTestJSON-368419735 tempest-DeleteServersTestJSON-368419735-project] Calling method '>' {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:32:42.382547 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-e037e051-5f08-471b-9309-058a0d811644 tempest-DeleteServersTestJSON-368419735 tempest-DeleteServersTestJSON-368419735-project] [instance: 618dfcb0-fc23-4985-a7e0-9ec51837519b] Fetching instance by UUID {{(pid=102148) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:32:42.399801 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-e037e051-5f08-471b-9309-058a0d811644 tempest-DeleteServersTestJSON-368419735 tempest-DeleteServersTestJSON-368419735-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:32:42.400854 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-e037e051-5f08-471b-9309-058a0d811644 tempest-DeleteServersTestJSON-368419735 tempest-DeleteServersTestJSON-368419735-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:32:42.402745 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-e037e051-5f08-471b-9309-058a0d811644 tempest-DeleteServersTestJSON-368419735 tempest-DeleteServersTestJSON-368419735-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:32:42.403595 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-e037e051-5f08-471b-9309-058a0d811644 tempest-DeleteServersTestJSON-368419735 tempest-DeleteServersTestJSON-368419735-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:32:42.543476 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.wsgi [None req-e037e051-5f08-471b-9309-058a0d811644 tempest-DeleteServersTestJSON-368419735 tempest-DeleteServersTestJSON-368419735-project] HTTP exception thrown: Instance 618dfcb0-fc23-4985-a7e0-9ec51837519b could not be found. Jun 24 16:32:42.545914 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-e037e051-5f08-471b-9309-058a0d811644 tempest-DeleteServersTestJSON-368419735 tempest-DeleteServersTestJSON-368419735-project] Returning 404 to user: Instance 618dfcb0-fc23-4985-a7e0-9ec51837519b could not be found. {{(pid=102148) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jun 24 16:32:42.548520 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-e037e051-5f08-471b-9309-058a0d811644 tempest-DeleteServersTestJSON-368419735 tempest-DeleteServersTestJSON-368419735-project] 10.222.0.18 "GET /compute/v2.1/servers/618dfcb0-fc23-4985-a7e0-9ec51837519b" status: 404 len: 111 microversion: 2.1 time: 0.177755 Jun 24 16:32:42.555543 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 69/120] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:32:42 2022] GET /compute/v2.1/servers/618dfcb0-fc23-4985-a7e0-9ec51837519b => generated 111 bytes in 186 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 16:32:42.578001 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [req-f888ab90-8e3b-40cb-9d03-29c4565f7e04 req-6ad01b65-cfaa-4da1-b1d9-823d9a9b75de service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6d4e660b-2f36-40f0-9d87-14b6146eb533", "tag": "eee1df7d-b70e-4fac-bc05-3f41f73577d9"}]} {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 16:32:42.582936 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 24 16:32:42.582936 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: warnings.warn(msg) Jun 24 16:32:42.618605 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [req-f888ab90-8e3b-40cb-9d03-29c4565f7e04 req-6ad01b65-cfaa-4da1-b1d9-823d9a9b75de service nova] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:32:42.620384 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [req-f888ab90-8e3b-40cb-9d03-29c4565f7e04 req-6ad01b65-cfaa-4da1-b1d9-823d9a9b75de service nova] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:32:42.639178 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.compute.server_external_events [req-f888ab90-8e3b-40cb-9d03-29c4565f7e04 req-6ad01b65-cfaa-4da1-b1d9-823d9a9b75de service nova] Creating event network-changed:eee1df7d-b70e-4fac-bc05-3f41f73577d9 for instance 6d4e660b-2f36-40f0-9d87-14b6146eb533 on hv-cinder-84718 Jun 24 16:32:42.646273 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [req-f888ab90-8e3b-40cb-9d03-29c4565f7e04 req-6ad01b65-cfaa-4da1-b1d9-823d9a9b75de service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087879 Jun 24 16:32:42.646977 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 70/121] 10.222.0.18 () {64 vars in 1317 bytes} [Fri Jun 24 16:32:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 16:32:42.896166 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-029cfa93-603c-455c-8dbf-7227dcec0cac tempest-DeleteServersTestJSON-368419735 tempest-DeleteServersTestJSON-368419735-project] Calling method '>' {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:32:42.898024 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-029cfa93-603c-455c-8dbf-7227dcec0cac tempest-DeleteServersTestJSON-368419735 tempest-DeleteServersTestJSON-368419735-project] [instance: 618dfcb0-fc23-4985-a7e0-9ec51837519b] Fetching instance by UUID {{(pid=102148) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:32:42.908409 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-029cfa93-603c-455c-8dbf-7227dcec0cac tempest-DeleteServersTestJSON-368419735 tempest-DeleteServersTestJSON-368419735-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:32:42.909081 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-029cfa93-603c-455c-8dbf-7227dcec0cac tempest-DeleteServersTestJSON-368419735 tempest-DeleteServersTestJSON-368419735-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:32:42.910113 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-029cfa93-603c-455c-8dbf-7227dcec0cac tempest-DeleteServersTestJSON-368419735 tempest-DeleteServersTestJSON-368419735-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:32:42.910939 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-029cfa93-603c-455c-8dbf-7227dcec0cac tempest-DeleteServersTestJSON-368419735 tempest-DeleteServersTestJSON-368419735-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:32:42.970026 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.wsgi [None req-029cfa93-603c-455c-8dbf-7227dcec0cac tempest-DeleteServersTestJSON-368419735 tempest-DeleteServersTestJSON-368419735-project] HTTP exception thrown: Instance 618dfcb0-fc23-4985-a7e0-9ec51837519b could not be found. Jun 24 16:32:42.970923 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-029cfa93-603c-455c-8dbf-7227dcec0cac tempest-DeleteServersTestJSON-368419735 tempest-DeleteServersTestJSON-368419735-project] Returning 404 to user: Instance 618dfcb0-fc23-4985-a7e0-9ec51837519b could not be found. {{(pid=102148) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jun 24 16:32:42.972477 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-029cfa93-603c-455c-8dbf-7227dcec0cac tempest-DeleteServersTestJSON-368419735 tempest-DeleteServersTestJSON-368419735-project] 10.222.0.18 "GET /compute/v2.1/servers/618dfcb0-fc23-4985-a7e0-9ec51837519b/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.084643 Jun 24 16:32:42.974279 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 71/122] 10.222.0.18 () {58 vars in 1301 bytes} [Fri Jun 24 16:32:42 2022] GET /compute/v2.1/servers/618dfcb0-fc23-4985-a7e0-9ec51837519b/os-volume_attachments => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 24 16:32:43.197810 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-bac84d17-d5d7-41d4-a84d-25d079c009ee tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c286a3f03048689e5ec552bb89c161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09584de3a4b14c5a90eb9b1c2149d6fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:32:43.215695 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-bac84d17-d5d7-41d4-a84d-25d079c009ee tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] 10.222.0.18 "GET /compute/v2.1/servers/1c690e22-ec9b-423d-9f32-e01ffb3fa4b1" status: 200 len: 1521 microversion: 2.1 time: 1.327392 Jun 24 16:32:43.219648 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 52/123] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:32:41 2022] GET /compute/v2.1/servers/1c690e22-ec9b-423d-9f32-e01ffb3fa4b1 => generated 1521 bytes in 1335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 16:32:43.394353 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-31fece70-31e0-4237-a76d-5b7d07c96078 tempest-VolumesActionsTest-1515172499 tempest-VolumesActionsTest-1515172499-project] Calling method '>' {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:32:43.395540 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-31fece70-31e0-4237-a76d-5b7d07c96078 tempest-VolumesActionsTest-1515172499 tempest-VolumesActionsTest-1515172499-project] [instance: 6d4e660b-2f36-40f0-9d87-14b6146eb533] Fetching instance by UUID {{(pid=102148) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:32:43.420239 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-31fece70-31e0-4237-a76d-5b7d07c96078 tempest-VolumesActionsTest-1515172499 tempest-VolumesActionsTest-1515172499-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:32:43.421312 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-31fece70-31e0-4237-a76d-5b7d07c96078 tempest-VolumesActionsTest-1515172499 tempest-VolumesActionsTest-1515172499-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:32:43.425248 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-31fece70-31e0-4237-a76d-5b7d07c96078 tempest-VolumesActionsTest-1515172499 tempest-VolumesActionsTest-1515172499-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:32:43.429301 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-31fece70-31e0-4237-a76d-5b7d07c96078 tempest-VolumesActionsTest-1515172499 tempest-VolumesActionsTest-1515172499-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:32:44.240253 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-47f7b9a6-23f1-4ecb-86b2-b1a9169d3e38 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Calling method '>' {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:32:44.240958 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-47f7b9a6-23f1-4ecb-86b2-b1a9169d3e38 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] [instance: 1c690e22-ec9b-423d-9f32-e01ffb3fa4b1] Fetching instance by UUID {{(pid=102149) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:32:44.269229 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-47f7b9a6-23f1-4ecb-86b2-b1a9169d3e38 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:32:44.270025 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-47f7b9a6-23f1-4ecb-86b2-b1a9169d3e38 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:32:44.271496 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-47f7b9a6-23f1-4ecb-86b2-b1a9169d3e38 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:32:44.272290 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-47f7b9a6-23f1-4ecb-86b2-b1a9169d3e38 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:32:44.824888 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-31fece70-31e0-4237-a76d-5b7d07c96078 tempest-VolumesActionsTest-1515172499 tempest-VolumesActionsTest-1515172499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dd95251dce947f8bb6a2739a6557dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fd35a8f65244b5a18f841af49d5c7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:32:44.849473 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-31fece70-31e0-4237-a76d-5b7d07c96078 tempest-VolumesActionsTest-1515172499 tempest-VolumesActionsTest-1515172499-project] 10.222.0.18 "GET /compute/v2.1/servers/6d4e660b-2f36-40f0-9d87-14b6146eb533" status: 200 len: 1314 microversion: 2.1 time: 1.461233 Jun 24 16:32:44.865059 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 72/124] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:32:43 2022] GET /compute/v2.1/servers/6d4e660b-2f36-40f0-9d87-14b6146eb533 => generated 1314 bytes in 1478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 16:32:44.879237 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-de05b3d4-0932-40ac-8e3f-d1188057bdb5 tempest-DeleteServersTestJSON-368419735 tempest-DeleteServersTestJSON-368419735-project] Calling method '>' {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:32:44.883189 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-de05b3d4-0932-40ac-8e3f-d1188057bdb5 tempest-DeleteServersTestJSON-368419735 tempest-DeleteServersTestJSON-368419735-project] [instance: 618dfcb0-fc23-4985-a7e0-9ec51837519b] Fetching instance by UUID {{(pid=102148) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:32:44.914576 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-de05b3d4-0932-40ac-8e3f-d1188057bdb5 tempest-DeleteServersTestJSON-368419735 tempest-DeleteServersTestJSON-368419735-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:32:44.918406 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-de05b3d4-0932-40ac-8e3f-d1188057bdb5 tempest-DeleteServersTestJSON-368419735 tempest-DeleteServersTestJSON-368419735-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:32:44.922101 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-de05b3d4-0932-40ac-8e3f-d1188057bdb5 tempest-DeleteServersTestJSON-368419735 tempest-DeleteServersTestJSON-368419735-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:32:44.925065 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-de05b3d4-0932-40ac-8e3f-d1188057bdb5 tempest-DeleteServersTestJSON-368419735 tempest-DeleteServersTestJSON-368419735-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:32:45.074541 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.wsgi [None req-de05b3d4-0932-40ac-8e3f-d1188057bdb5 tempest-DeleteServersTestJSON-368419735 tempest-DeleteServersTestJSON-368419735-project] HTTP exception thrown: Instance 618dfcb0-fc23-4985-a7e0-9ec51837519b could not be found. Jun 24 16:32:45.075710 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-de05b3d4-0932-40ac-8e3f-d1188057bdb5 tempest-DeleteServersTestJSON-368419735 tempest-DeleteServersTestJSON-368419735-project] Returning 404 to user: Instance 618dfcb0-fc23-4985-a7e0-9ec51837519b could not be found. {{(pid=102148) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jun 24 16:32:45.077735 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-de05b3d4-0932-40ac-8e3f-d1188057bdb5 tempest-DeleteServersTestJSON-368419735 tempest-DeleteServersTestJSON-368419735-project] 10.222.0.18 "DELETE /compute/v2.1/servers/618dfcb0-fc23-4985-a7e0-9ec51837519b" status: 404 len: 111 microversion: 2.1 time: 0.210537 Jun 24 16:32:45.079933 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 73/125] 10.222.0.18 () {58 vars in 1238 bytes} [Fri Jun 24 16:32:44 2022] DELETE /compute/v2.1/servers/618dfcb0-fc23-4985-a7e0-9ec51837519b => generated 111 bytes in 214 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 16:32:45.089957 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [req-85cb4372-e98c-477e-9681-b66d0b100c96 req-6b3ac361-6cde-4a80-8242-5318669bc466 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2fa4f019-3cbd-4b41-a0fc-6513f46474c0", "tag": "fc075890-b996-4078-bc3c-b93d621d7267"}]} {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 16:32:45.093661 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 24 16:32:45.093661 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: warnings.warn(msg) Jun 24 16:32:45.113638 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [req-85cb4372-e98c-477e-9681-b66d0b100c96 req-6b3ac361-6cde-4a80-8242-5318669bc466 service nova] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:32:45.115201 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [req-85cb4372-e98c-477e-9681-b66d0b100c96 req-6b3ac361-6cde-4a80-8242-5318669bc466 service nova] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:32:45.156737 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.compute.server_external_events [req-85cb4372-e98c-477e-9681-b66d0b100c96 req-6b3ac361-6cde-4a80-8242-5318669bc466 service nova] Creating event network-changed:fc075890-b996-4078-bc3c-b93d621d7267 for instance 2fa4f019-3cbd-4b41-a0fc-6513f46474c0 on hv-cinder-84718 Jun 24 16:32:45.168143 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [req-85cb4372-e98c-477e-9681-b66d0b100c96 req-6b3ac361-6cde-4a80-8242-5318669bc466 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085617 Jun 24 16:32:45.170117 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 74/126] 10.222.0.18 () {64 vars in 1317 bytes} [Fri Jun 24 16:32:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 16:32:45.184652 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-bd8bb964-f930-4f8a-8a9a-012bfbfc8a7d tempest-DeleteServersTestJSON-368419735 tempest-DeleteServersTestJSON-368419735-project] Calling method '>' {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:32:45.186268 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-bd8bb964-f930-4f8a-8a9a-012bfbfc8a7d tempest-DeleteServersTestJSON-368419735 tempest-DeleteServersTestJSON-368419735-project] [instance: 618dfcb0-fc23-4985-a7e0-9ec51837519b] Fetching instance by UUID {{(pid=102148) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:32:45.203463 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-bd8bb964-f930-4f8a-8a9a-012bfbfc8a7d tempest-DeleteServersTestJSON-368419735 tempest-DeleteServersTestJSON-368419735-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:32:45.204902 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-bd8bb964-f930-4f8a-8a9a-012bfbfc8a7d tempest-DeleteServersTestJSON-368419735 tempest-DeleteServersTestJSON-368419735-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:32:45.207093 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-bd8bb964-f930-4f8a-8a9a-012bfbfc8a7d tempest-DeleteServersTestJSON-368419735 tempest-DeleteServersTestJSON-368419735-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:32:45.208116 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-bd8bb964-f930-4f8a-8a9a-012bfbfc8a7d tempest-DeleteServersTestJSON-368419735 tempest-DeleteServersTestJSON-368419735-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:32:45.301727 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-47f7b9a6-23f1-4ecb-86b2-b1a9169d3e38 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c286a3f03048689e5ec552bb89c161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09584de3a4b14c5a90eb9b1c2149d6fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:32:45.342876 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-47f7b9a6-23f1-4ecb-86b2-b1a9169d3e38 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] 10.222.0.18 "GET /compute/v2.1/servers/1c690e22-ec9b-423d-9f32-e01ffb3fa4b1" status: 200 len: 1521 microversion: 2.1 time: 1.106941 Jun 24 16:32:45.351926 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 53/127] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:32:44 2022] GET /compute/v2.1/servers/1c690e22-ec9b-423d-9f32-e01ffb3fa4b1 => generated 1521 bytes in 1117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 16:32:45.387474 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.wsgi [None req-bd8bb964-f930-4f8a-8a9a-012bfbfc8a7d tempest-DeleteServersTestJSON-368419735 tempest-DeleteServersTestJSON-368419735-project] HTTP exception thrown: Instance 618dfcb0-fc23-4985-a7e0-9ec51837519b could not be found. Jun 24 16:32:45.388818 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-bd8bb964-f930-4f8a-8a9a-012bfbfc8a7d tempest-DeleteServersTestJSON-368419735 tempest-DeleteServersTestJSON-368419735-project] Returning 404 to user: Instance 618dfcb0-fc23-4985-a7e0-9ec51837519b could not be found. {{(pid=102148) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jun 24 16:32:45.390515 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-bd8bb964-f930-4f8a-8a9a-012bfbfc8a7d tempest-DeleteServersTestJSON-368419735 tempest-DeleteServersTestJSON-368419735-project] 10.222.0.18 "GET /compute/v2.1/servers/618dfcb0-fc23-4985-a7e0-9ec51837519b" status: 404 len: 111 microversion: 2.1 time: 0.217489 Jun 24 16:32:45.391894 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 75/128] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:32:45 2022] GET /compute/v2.1/servers/618dfcb0-fc23-4985-a7e0-9ec51837519b => generated 111 bytes in 220 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 16:32:45.899728 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-8e69cfbb-93bf-496e-8158-f3092b94c07e tempest-VolumesActionsTest-1515172499 tempest-VolumesActionsTest-1515172499-project] Calling method '>' {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:32:45.903978 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-8e69cfbb-93bf-496e-8158-f3092b94c07e tempest-VolumesActionsTest-1515172499 tempest-VolumesActionsTest-1515172499-project] [instance: 6d4e660b-2f36-40f0-9d87-14b6146eb533] Fetching instance by UUID {{(pid=102149) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:32:45.930032 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-8e69cfbb-93bf-496e-8158-f3092b94c07e tempest-VolumesActionsTest-1515172499 tempest-VolumesActionsTest-1515172499-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:32:45.930845 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-8e69cfbb-93bf-496e-8158-f3092b94c07e tempest-VolumesActionsTest-1515172499 tempest-VolumesActionsTest-1515172499-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:32:45.932279 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-8e69cfbb-93bf-496e-8158-f3092b94c07e tempest-VolumesActionsTest-1515172499 tempest-VolumesActionsTest-1515172499-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:32:45.933057 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-8e69cfbb-93bf-496e-8158-f3092b94c07e tempest-VolumesActionsTest-1515172499 tempest-VolumesActionsTest-1515172499-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:32:46.379643 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-06c67307-1290-4e80-b5be-4e705fffbe38 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Calling method '>' {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:32:46.381109 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-06c67307-1290-4e80-b5be-4e705fffbe38 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] [instance: 1c690e22-ec9b-423d-9f32-e01ffb3fa4b1] Fetching instance by UUID {{(pid=102148) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:32:46.391126 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-06c67307-1290-4e80-b5be-4e705fffbe38 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:32:46.392200 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-06c67307-1290-4e80-b5be-4e705fffbe38 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:32:46.393603 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-06c67307-1290-4e80-b5be-4e705fffbe38 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:32:46.394412 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-06c67307-1290-4e80-b5be-4e705fffbe38 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:32:47.624937 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-8e69cfbb-93bf-496e-8158-f3092b94c07e tempest-VolumesActionsTest-1515172499 tempest-VolumesActionsTest-1515172499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dd95251dce947f8bb6a2739a6557dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fd35a8f65244b5a18f841af49d5c7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:32:47.656577 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-8e69cfbb-93bf-496e-8158-f3092b94c07e tempest-VolumesActionsTest-1515172499 tempest-VolumesActionsTest-1515172499-project] 10.222.0.18 "GET /compute/v2.1/servers/6d4e660b-2f36-40f0-9d87-14b6146eb533" status: 200 len: 1314 microversion: 2.1 time: 1.765082 Jun 24 16:32:47.673042 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 54/129] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:32:45 2022] GET /compute/v2.1/servers/6d4e660b-2f36-40f0-9d87-14b6146eb533 => generated 1314 bytes in 1783 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 16:32:47.950623 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-06c67307-1290-4e80-b5be-4e705fffbe38 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c286a3f03048689e5ec552bb89c161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09584de3a4b14c5a90eb9b1c2149d6fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:32:47.969778 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-06c67307-1290-4e80-b5be-4e705fffbe38 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] 10.222.0.18 "GET /compute/v2.1/servers/1c690e22-ec9b-423d-9f32-e01ffb3fa4b1" status: 200 len: 1521 microversion: 2.1 time: 1.595912 Jun 24 16:32:47.979226 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 76/130] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:32:46 2022] GET /compute/v2.1/servers/1c690e22-ec9b-423d-9f32-e01ffb3fa4b1 => generated 1521 bytes in 1607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 16:32:48.686879 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-3ec9ef00-79ed-45ec-9b65-8d52e39eff3a tempest-VolumesActionsTest-1515172499 tempest-VolumesActionsTest-1515172499-project] Calling method '>' {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:32:48.688020 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-3ec9ef00-79ed-45ec-9b65-8d52e39eff3a tempest-VolumesActionsTest-1515172499 tempest-VolumesActionsTest-1515172499-project] [instance: 6d4e660b-2f36-40f0-9d87-14b6146eb533] Fetching instance by UUID {{(pid=102149) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:32:48.710248 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-3ec9ef00-79ed-45ec-9b65-8d52e39eff3a tempest-VolumesActionsTest-1515172499 tempest-VolumesActionsTest-1515172499-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:32:48.710747 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-3ec9ef00-79ed-45ec-9b65-8d52e39eff3a tempest-VolumesActionsTest-1515172499 tempest-VolumesActionsTest-1515172499-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:32:48.711539 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-3ec9ef00-79ed-45ec-9b65-8d52e39eff3a tempest-VolumesActionsTest-1515172499 tempest-VolumesActionsTest-1515172499-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:32:48.712223 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-3ec9ef00-79ed-45ec-9b65-8d52e39eff3a tempest-VolumesActionsTest-1515172499 tempest-VolumesActionsTest-1515172499-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:32:49.002824 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-9d22908a-4eef-4cf0-a6b2-662ac2759f02 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Calling method '>' {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:32:49.003451 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-9d22908a-4eef-4cf0-a6b2-662ac2759f02 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] [instance: 1c690e22-ec9b-423d-9f32-e01ffb3fa4b1] Fetching instance by UUID {{(pid=102148) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:32:49.022752 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-9d22908a-4eef-4cf0-a6b2-662ac2759f02 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:32:49.023078 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-9d22908a-4eef-4cf0-a6b2-662ac2759f02 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:32:49.023695 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-9d22908a-4eef-4cf0-a6b2-662ac2759f02 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:32:49.024124 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-9d22908a-4eef-4cf0-a6b2-662ac2759f02 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:32:49.479299 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-3ec9ef00-79ed-45ec-9b65-8d52e39eff3a tempest-VolumesActionsTest-1515172499 tempest-VolumesActionsTest-1515172499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dd95251dce947f8bb6a2739a6557dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fd35a8f65244b5a18f841af49d5c7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:32:49.495078 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-3ec9ef00-79ed-45ec-9b65-8d52e39eff3a tempest-VolumesActionsTest-1515172499 tempest-VolumesActionsTest-1515172499-project] 10.222.0.18 "GET /compute/v2.1/servers/6d4e660b-2f36-40f0-9d87-14b6146eb533" status: 200 len: 1314 microversion: 2.1 time: 0.812567 Jun 24 16:32:49.500626 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 55/131] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:32:48 2022] GET /compute/v2.1/servers/6d4e660b-2f36-40f0-9d87-14b6146eb533 => generated 1314 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 16:32:49.751447 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-9d22908a-4eef-4cf0-a6b2-662ac2759f02 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c286a3f03048689e5ec552bb89c161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09584de3a4b14c5a90eb9b1c2149d6fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:32:49.784251 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-9d22908a-4eef-4cf0-a6b2-662ac2759f02 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] 10.222.0.18 "GET /compute/v2.1/servers/1c690e22-ec9b-423d-9f32-e01ffb3fa4b1" status: 200 len: 1521 microversion: 2.1 time: 0.784130 Jun 24 16:32:49.785224 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 77/132] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:32:48 2022] GET /compute/v2.1/servers/1c690e22-ec9b-423d-9f32-e01ffb3fa4b1 => generated 1521 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 16:32:50.520188 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-29de13f4-195a-4eeb-9b58-b4a5673460df tempest-VolumesActionsTest-1515172499 tempest-VolumesActionsTest-1515172499-project] Calling method '>' {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:32:50.521609 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-29de13f4-195a-4eeb-9b58-b4a5673460df tempest-VolumesActionsTest-1515172499 tempest-VolumesActionsTest-1515172499-project] [instance: 6d4e660b-2f36-40f0-9d87-14b6146eb533] Fetching instance by UUID {{(pid=102149) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:32:50.539342 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-29de13f4-195a-4eeb-9b58-b4a5673460df tempest-VolumesActionsTest-1515172499 tempest-VolumesActionsTest-1515172499-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:32:50.540689 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-29de13f4-195a-4eeb-9b58-b4a5673460df tempest-VolumesActionsTest-1515172499 tempest-VolumesActionsTest-1515172499-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:32:50.541757 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-29de13f4-195a-4eeb-9b58-b4a5673460df tempest-VolumesActionsTest-1515172499 tempest-VolumesActionsTest-1515172499-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:32:50.542400 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-29de13f4-195a-4eeb-9b58-b4a5673460df tempest-VolumesActionsTest-1515172499 tempest-VolumesActionsTest-1515172499-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:32:50.813218 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-afab837a-2394-46f4-888e-e42a2e00aa9b tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Calling method '>' {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:32:50.814056 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-afab837a-2394-46f4-888e-e42a2e00aa9b tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] [instance: 1c690e22-ec9b-423d-9f32-e01ffb3fa4b1] Fetching instance by UUID {{(pid=102148) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:32:50.827246 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-afab837a-2394-46f4-888e-e42a2e00aa9b tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:32:50.827950 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-afab837a-2394-46f4-888e-e42a2e00aa9b tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:32:50.829182 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-afab837a-2394-46f4-888e-e42a2e00aa9b tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:32:50.830098 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-afab837a-2394-46f4-888e-e42a2e00aa9b tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:32:51.474346 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-29de13f4-195a-4eeb-9b58-b4a5673460df tempest-VolumesActionsTest-1515172499 tempest-VolumesActionsTest-1515172499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dd95251dce947f8bb6a2739a6557dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fd35a8f65244b5a18f841af49d5c7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:32:51.485596 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-29de13f4-195a-4eeb-9b58-b4a5673460df tempest-VolumesActionsTest-1515172499 tempest-VolumesActionsTest-1515172499-project] 10.222.0.18 "GET /compute/v2.1/servers/6d4e660b-2f36-40f0-9d87-14b6146eb533" status: 200 len: 1314 microversion: 2.1 time: 0.969740 Jun 24 16:32:51.487482 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 56/133] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:32:50 2022] GET /compute/v2.1/servers/6d4e660b-2f36-40f0-9d87-14b6146eb533 => generated 1314 bytes in 972 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 16:32:51.507903 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-afab837a-2394-46f4-888e-e42a2e00aa9b tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c286a3f03048689e5ec552bb89c161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09584de3a4b14c5a90eb9b1c2149d6fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:32:51.522527 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-afab837a-2394-46f4-888e-e42a2e00aa9b tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] 10.222.0.18 "GET /compute/v2.1/servers/1c690e22-ec9b-423d-9f32-e01ffb3fa4b1" status: 200 len: 1521 microversion: 2.1 time: 0.715374 Jun 24 16:32:51.524079 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 78/134] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:32:50 2022] GET /compute/v2.1/servers/1c690e22-ec9b-423d-9f32-e01ffb3fa4b1 => generated 1521 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 16:32:52.522177 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-c9179a8b-ce4f-4e72-bd2f-4d0558c087ae tempest-VolumesActionsTest-1515172499 tempest-VolumesActionsTest-1515172499-project] Calling method '>' {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:32:52.535941 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-c9179a8b-ce4f-4e72-bd2f-4d0558c087ae tempest-VolumesActionsTest-1515172499 tempest-VolumesActionsTest-1515172499-project] [instance: 6d4e660b-2f36-40f0-9d87-14b6146eb533] Fetching instance by UUID {{(pid=102149) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:32:52.547905 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-c9179a8b-ce4f-4e72-bd2f-4d0558c087ae tempest-VolumesActionsTest-1515172499 tempest-VolumesActionsTest-1515172499-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:32:52.549264 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-c9179a8b-ce4f-4e72-bd2f-4d0558c087ae tempest-VolumesActionsTest-1515172499 tempest-VolumesActionsTest-1515172499-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:32:52.550167 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-c221e186-4f7e-43e8-8760-2dcbfc7a812e tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Calling method '>' {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:32:52.550871 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-c9179a8b-ce4f-4e72-bd2f-4d0558c087ae tempest-VolumesActionsTest-1515172499 tempest-VolumesActionsTest-1515172499-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:32:52.551224 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-c221e186-4f7e-43e8-8760-2dcbfc7a812e tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] [instance: 1c690e22-ec9b-423d-9f32-e01ffb3fa4b1] Fetching instance by UUID {{(pid=102148) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:32:52.551844 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-c9179a8b-ce4f-4e72-bd2f-4d0558c087ae tempest-VolumesActionsTest-1515172499 tempest-VolumesActionsTest-1515172499-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:32:52.573325 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-c221e186-4f7e-43e8-8760-2dcbfc7a812e tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:32:52.574278 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-c221e186-4f7e-43e8-8760-2dcbfc7a812e tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:32:52.578187 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-c221e186-4f7e-43e8-8760-2dcbfc7a812e tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:32:52.579593 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-c221e186-4f7e-43e8-8760-2dcbfc7a812e tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:32:53.216285 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-c221e186-4f7e-43e8-8760-2dcbfc7a812e tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c286a3f03048689e5ec552bb89c161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09584de3a4b14c5a90eb9b1c2149d6fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:32:53.227715 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-c221e186-4f7e-43e8-8760-2dcbfc7a812e tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] 10.222.0.18 "GET /compute/v2.1/servers/1c690e22-ec9b-423d-9f32-e01ffb3fa4b1" status: 200 len: 1521 microversion: 2.1 time: 0.683774 Jun 24 16:32:53.228297 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 79/135] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:32:52 2022] GET /compute/v2.1/servers/1c690e22-ec9b-423d-9f32-e01ffb3fa4b1 => generated 1521 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 16:32:53.251373 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-c9179a8b-ce4f-4e72-bd2f-4d0558c087ae tempest-VolumesActionsTest-1515172499 tempest-VolumesActionsTest-1515172499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dd95251dce947f8bb6a2739a6557dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fd35a8f65244b5a18f841af49d5c7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:32:53.266875 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-c9179a8b-ce4f-4e72-bd2f-4d0558c087ae tempest-VolumesActionsTest-1515172499 tempest-VolumesActionsTest-1515172499-project] 10.222.0.18 "GET /compute/v2.1/servers/6d4e660b-2f36-40f0-9d87-14b6146eb533" status: 200 len: 1314 microversion: 2.1 time: 0.759862 Jun 24 16:32:53.269418 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 57/136] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:32:52 2022] GET /compute/v2.1/servers/6d4e660b-2f36-40f0-9d87-14b6146eb533 => generated 1314 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 16:32:53.288220 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [req-340f47bd-8262-4aaf-8242-7649097f09a1 req-de1957bc-cdb3-4130-866c-ee9659bbf780 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6d4e660b-2f36-40f0-9d87-14b6146eb533", "name": "network-vif-plugged", "status": "completed", "tag": "eee1df7d-b70e-4fac-bc05-3f41f73577d9"}]} {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 16:32:53.291014 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 24 16:32:53.291014 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: warnings.warn(msg) Jun 24 16:32:53.307126 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [req-340f47bd-8262-4aaf-8242-7649097f09a1 req-de1957bc-cdb3-4130-866c-ee9659bbf780 service nova] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:32:53.307126 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [req-340f47bd-8262-4aaf-8242-7649097f09a1 req-de1957bc-cdb3-4130-866c-ee9659bbf780 service nova] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:32:53.337175 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.compute.server_external_events [req-340f47bd-8262-4aaf-8242-7649097f09a1 req-de1957bc-cdb3-4130-866c-ee9659bbf780 service nova] Creating event network-vif-plugged:eee1df7d-b70e-4fac-bc05-3f41f73577d9 for instance 6d4e660b-2f36-40f0-9d87-14b6146eb533 on hv-cinder-84718 Jun 24 16:32:53.346207 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [req-340f47bd-8262-4aaf-8242-7649097f09a1 req-de1957bc-cdb3-4130-866c-ee9659bbf780 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061867 Jun 24 16:32:53.351327 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 80/137] 10.222.0.18 () {64 vars in 1317 bytes} [Fri Jun 24 16:32:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 16:32:54.261574 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-299d7eba-f2d7-4a7b-8672-f2a5c9d02ce8 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Calling method '>' {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:32:54.264163 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-299d7eba-f2d7-4a7b-8672-f2a5c9d02ce8 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] [instance: 1c690e22-ec9b-423d-9f32-e01ffb3fa4b1] Fetching instance by UUID {{(pid=102149) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:32:54.278867 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-299d7eba-f2d7-4a7b-8672-f2a5c9d02ce8 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:32:54.292838 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-79da9649-4fe9-4248-86b8-b363e6e26b6f tempest-VolumesActionsTest-1515172499 tempest-VolumesActionsTest-1515172499-project] Calling method '>' {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:32:54.294044 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-79da9649-4fe9-4248-86b8-b363e6e26b6f tempest-VolumesActionsTest-1515172499 tempest-VolumesActionsTest-1515172499-project] [instance: 6d4e660b-2f36-40f0-9d87-14b6146eb533] Fetching instance by UUID {{(pid=102148) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:32:54.295155 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-299d7eba-f2d7-4a7b-8672-f2a5c9d02ce8 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:32:54.296765 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-299d7eba-f2d7-4a7b-8672-f2a5c9d02ce8 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:32:54.300480 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-299d7eba-f2d7-4a7b-8672-f2a5c9d02ce8 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:32:54.319369 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-79da9649-4fe9-4248-86b8-b363e6e26b6f tempest-VolumesActionsTest-1515172499 tempest-VolumesActionsTest-1515172499-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:32:54.319818 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-79da9649-4fe9-4248-86b8-b363e6e26b6f tempest-VolumesActionsTest-1515172499 tempest-VolumesActionsTest-1515172499-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:32:54.320600 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-79da9649-4fe9-4248-86b8-b363e6e26b6f tempest-VolumesActionsTest-1515172499 tempest-VolumesActionsTest-1515172499-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:32:54.321035 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-79da9649-4fe9-4248-86b8-b363e6e26b6f tempest-VolumesActionsTest-1515172499 tempest-VolumesActionsTest-1515172499-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:32:54.855723 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-79da9649-4fe9-4248-86b8-b363e6e26b6f tempest-VolumesActionsTest-1515172499 tempest-VolumesActionsTest-1515172499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dd95251dce947f8bb6a2739a6557dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fd35a8f65244b5a18f841af49d5c7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:32:54.866203 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-299d7eba-f2d7-4a7b-8672-f2a5c9d02ce8 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c286a3f03048689e5ec552bb89c161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09584de3a4b14c5a90eb9b1c2149d6fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:32:54.880560 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-79da9649-4fe9-4248-86b8-b363e6e26b6f tempest-VolumesActionsTest-1515172499 tempest-VolumesActionsTest-1515172499-project] 10.222.0.18 "GET /compute/v2.1/servers/6d4e660b-2f36-40f0-9d87-14b6146eb533" status: 200 len: 1314 microversion: 2.1 time: 0.595900 Jun 24 16:32:54.884011 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-299d7eba-f2d7-4a7b-8672-f2a5c9d02ce8 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] 10.222.0.18 "GET /compute/v2.1/servers/1c690e22-ec9b-423d-9f32-e01ffb3fa4b1" status: 200 len: 1521 microversion: 2.1 time: 0.631204 Jun 24 16:32:54.885761 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 58/138] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:32:54 2022] GET /compute/v2.1/servers/1c690e22-ec9b-423d-9f32-e01ffb3fa4b1 => generated 1521 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 16:32:54.890664 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 81/139] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:32:54 2022] GET /compute/v2.1/servers/6d4e660b-2f36-40f0-9d87-14b6146eb533 => generated 1314 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 16:32:55.927832 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-66a5a1c3-f278-4bf1-a3fc-b7ab90d2e899 tempest-VolumesActionsTest-1515172499 tempest-VolumesActionsTest-1515172499-project] Calling method '>' {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:32:55.928957 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-66a5a1c3-f278-4bf1-a3fc-b7ab90d2e899 tempest-VolumesActionsTest-1515172499 tempest-VolumesActionsTest-1515172499-project] [instance: 6d4e660b-2f36-40f0-9d87-14b6146eb533] Fetching instance by UUID {{(pid=102149) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:32:55.932018 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-97b52567-b516-4399-9693-f5707b377b15 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Calling method '>' {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:32:55.939615 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-97b52567-b516-4399-9693-f5707b377b15 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] [instance: 1c690e22-ec9b-423d-9f32-e01ffb3fa4b1] Fetching instance by UUID {{(pid=102148) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:32:55.963249 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-66a5a1c3-f278-4bf1-a3fc-b7ab90d2e899 tempest-VolumesActionsTest-1515172499 tempest-VolumesActionsTest-1515172499-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:32:55.964160 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-66a5a1c3-f278-4bf1-a3fc-b7ab90d2e899 tempest-VolumesActionsTest-1515172499 tempest-VolumesActionsTest-1515172499-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:32:55.965538 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-66a5a1c3-f278-4bf1-a3fc-b7ab90d2e899 tempest-VolumesActionsTest-1515172499 tempest-VolumesActionsTest-1515172499-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:32:55.966353 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-66a5a1c3-f278-4bf1-a3fc-b7ab90d2e899 tempest-VolumesActionsTest-1515172499 tempest-VolumesActionsTest-1515172499-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:32:55.968928 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-97b52567-b516-4399-9693-f5707b377b15 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:32:55.969473 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-97b52567-b516-4399-9693-f5707b377b15 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:32:55.970964 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-97b52567-b516-4399-9693-f5707b377b15 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:32:55.975551 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-97b52567-b516-4399-9693-f5707b377b15 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:32:56.955319 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-66a5a1c3-f278-4bf1-a3fc-b7ab90d2e899 tempest-VolumesActionsTest-1515172499 tempest-VolumesActionsTest-1515172499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dd95251dce947f8bb6a2739a6557dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fd35a8f65244b5a18f841af49d5c7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:32:56.972084 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-97b52567-b516-4399-9693-f5707b377b15 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c286a3f03048689e5ec552bb89c161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09584de3a4b14c5a90eb9b1c2149d6fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:32:56.983737 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-66a5a1c3-f278-4bf1-a3fc-b7ab90d2e899 tempest-VolumesActionsTest-1515172499 tempest-VolumesActionsTest-1515172499-project] 10.222.0.18 "GET /compute/v2.1/servers/6d4e660b-2f36-40f0-9d87-14b6146eb533" status: 200 len: 1314 microversion: 2.1 time: 1.078861 Jun 24 16:32:56.989158 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 59/140] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:32:55 2022] GET /compute/v2.1/servers/6d4e660b-2f36-40f0-9d87-14b6146eb533 => generated 1314 bytes in 1088 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 16:32:56.994388 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-97b52567-b516-4399-9693-f5707b377b15 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] 10.222.0.18 "GET /compute/v2.1/servers/1c690e22-ec9b-423d-9f32-e01ffb3fa4b1" status: 200 len: 1521 microversion: 2.1 time: 1.074083 Jun 24 16:32:57.002559 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 82/141] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:32:55 2022] GET /compute/v2.1/servers/1c690e22-ec9b-423d-9f32-e01ffb3fa4b1 => generated 1521 bytes in 1084 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 16:32:58.010305 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-def201fa-21e8-48a3-ab31-c6e2ee834a89 tempest-VolumesActionsTest-1515172499 tempest-VolumesActionsTest-1515172499-project] Calling method '>' {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:32:58.011439 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-def201fa-21e8-48a3-ab31-c6e2ee834a89 tempest-VolumesActionsTest-1515172499 tempest-VolumesActionsTest-1515172499-project] [instance: 6d4e660b-2f36-40f0-9d87-14b6146eb533] Fetching instance by UUID {{(pid=102149) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:32:58.025002 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-def201fa-21e8-48a3-ab31-c6e2ee834a89 tempest-VolumesActionsTest-1515172499 tempest-VolumesActionsTest-1515172499-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:32:58.025428 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-def201fa-21e8-48a3-ab31-c6e2ee834a89 tempest-VolumesActionsTest-1515172499 tempest-VolumesActionsTest-1515172499-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:32:58.026407 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-def201fa-21e8-48a3-ab31-c6e2ee834a89 tempest-VolumesActionsTest-1515172499 tempest-VolumesActionsTest-1515172499-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:32:58.026902 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-def201fa-21e8-48a3-ab31-c6e2ee834a89 tempest-VolumesActionsTest-1515172499 tempest-VolumesActionsTest-1515172499-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:32:58.036646 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-f608572a-5d2f-46be-aa3c-f4c910f64eb2 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Calling method '>' {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:32:58.037781 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-f608572a-5d2f-46be-aa3c-f4c910f64eb2 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] [instance: 1c690e22-ec9b-423d-9f32-e01ffb3fa4b1] Fetching instance by UUID {{(pid=102148) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:32:58.065601 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-f608572a-5d2f-46be-aa3c-f4c910f64eb2 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:32:58.066742 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-f608572a-5d2f-46be-aa3c-f4c910f64eb2 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:32:58.068163 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-f608572a-5d2f-46be-aa3c-f4c910f64eb2 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:32:58.069072 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-f608572a-5d2f-46be-aa3c-f4c910f64eb2 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:32:58.622519 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-def201fa-21e8-48a3-ab31-c6e2ee834a89 tempest-VolumesActionsTest-1515172499 tempest-VolumesActionsTest-1515172499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dd95251dce947f8bb6a2739a6557dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fd35a8f65244b5a18f841af49d5c7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:32:58.634467 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-f608572a-5d2f-46be-aa3c-f4c910f64eb2 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c286a3f03048689e5ec552bb89c161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09584de3a4b14c5a90eb9b1c2149d6fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:32:58.638505 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-def201fa-21e8-48a3-ab31-c6e2ee834a89 tempest-VolumesActionsTest-1515172499 tempest-VolumesActionsTest-1515172499-project] 10.222.0.18 "GET /compute/v2.1/servers/6d4e660b-2f36-40f0-9d87-14b6146eb533" status: 200 len: 1314 microversion: 2.1 time: 0.636635 Jun 24 16:32:58.640293 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 60/142] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:32:57 2022] GET /compute/v2.1/servers/6d4e660b-2f36-40f0-9d87-14b6146eb533 => generated 1314 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 16:32:58.645350 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-f608572a-5d2f-46be-aa3c-f4c910f64eb2 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] 10.222.0.18 "GET /compute/v2.1/servers/1c690e22-ec9b-423d-9f32-e01ffb3fa4b1" status: 200 len: 1521 microversion: 2.1 time: 0.616571 Jun 24 16:32:58.646455 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 83/143] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:32:58 2022] GET /compute/v2.1/servers/1c690e22-ec9b-423d-9f32-e01ffb3fa4b1 => generated 1521 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 16:32:59.672777 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-4f6bdb86-f3b6-4a88-93bd-23e6206a923e tempest-VolumesActionsTest-1515172499 tempest-VolumesActionsTest-1515172499-project] Calling method '>' {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:32:59.675324 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-4b9ade9d-5c77-4caf-be07-6f585e3dae9b tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Calling method '>' {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:32:59.678363 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-4b9ade9d-5c77-4caf-be07-6f585e3dae9b tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] [instance: 1c690e22-ec9b-423d-9f32-e01ffb3fa4b1] Fetching instance by UUID {{(pid=102148) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:32:59.679904 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-4f6bdb86-f3b6-4a88-93bd-23e6206a923e tempest-VolumesActionsTest-1515172499 tempest-VolumesActionsTest-1515172499-project] [instance: 6d4e660b-2f36-40f0-9d87-14b6146eb533] Fetching instance by UUID {{(pid=102149) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:32:59.695431 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-4b9ade9d-5c77-4caf-be07-6f585e3dae9b tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:32:59.696824 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-4b9ade9d-5c77-4caf-be07-6f585e3dae9b tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:32:59.699300 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-4b9ade9d-5c77-4caf-be07-6f585e3dae9b tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:32:59.700767 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-4b9ade9d-5c77-4caf-be07-6f585e3dae9b tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:32:59.709042 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-4f6bdb86-f3b6-4a88-93bd-23e6206a923e tempest-VolumesActionsTest-1515172499 tempest-VolumesActionsTest-1515172499-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:32:59.709792 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-4f6bdb86-f3b6-4a88-93bd-23e6206a923e tempest-VolumesActionsTest-1515172499 tempest-VolumesActionsTest-1515172499-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:32:59.711155 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-4f6bdb86-f3b6-4a88-93bd-23e6206a923e tempest-VolumesActionsTest-1515172499 tempest-VolumesActionsTest-1515172499-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:32:59.711882 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-4f6bdb86-f3b6-4a88-93bd-23e6206a923e tempest-VolumesActionsTest-1515172499 tempest-VolumesActionsTest-1515172499-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:33:00.165988 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-4f6bdb86-f3b6-4a88-93bd-23e6206a923e tempest-VolumesActionsTest-1515172499 tempest-VolumesActionsTest-1515172499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dd95251dce947f8bb6a2739a6557dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fd35a8f65244b5a18f841af49d5c7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:33:00.169284 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-4b9ade9d-5c77-4caf-be07-6f585e3dae9b tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c286a3f03048689e5ec552bb89c161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09584de3a4b14c5a90eb9b1c2149d6fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:33:00.179595 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-4b9ade9d-5c77-4caf-be07-6f585e3dae9b tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] 10.222.0.18 "GET /compute/v2.1/servers/1c690e22-ec9b-423d-9f32-e01ffb3fa4b1" status: 200 len: 1521 microversion: 2.1 time: 0.511724 Jun 24 16:33:00.180465 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 84/144] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:32:59 2022] GET /compute/v2.1/servers/1c690e22-ec9b-423d-9f32-e01ffb3fa4b1 => generated 1521 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 16:33:00.195273 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-4f6bdb86-f3b6-4a88-93bd-23e6206a923e tempest-VolumesActionsTest-1515172499 tempest-VolumesActionsTest-1515172499-project] 10.222.0.18 "GET /compute/v2.1/servers/6d4e660b-2f36-40f0-9d87-14b6146eb533" status: 200 len: 1314 microversion: 2.1 time: 0.521061 Jun 24 16:33:00.196232 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 61/145] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:32:59 2022] GET /compute/v2.1/servers/6d4e660b-2f36-40f0-9d87-14b6146eb533 => generated 1314 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 16:33:01.205640 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-8b96fae9-957e-4e7d-beee-67444befe660 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Calling method '>' {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:33:01.208600 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-8b96fae9-957e-4e7d-beee-67444befe660 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] [instance: 1c690e22-ec9b-423d-9f32-e01ffb3fa4b1] Fetching instance by UUID {{(pid=102148) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:33:01.214032 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-b8b36b78-2996-4120-95b2-78182d9d37d6 tempest-VolumesActionsTest-1515172499 tempest-VolumesActionsTest-1515172499-project] Calling method '>' {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:33:01.216016 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-b8b36b78-2996-4120-95b2-78182d9d37d6 tempest-VolumesActionsTest-1515172499 tempest-VolumesActionsTest-1515172499-project] [instance: 6d4e660b-2f36-40f0-9d87-14b6146eb533] Fetching instance by UUID {{(pid=102149) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:33:01.220973 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-8b96fae9-957e-4e7d-beee-67444befe660 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:33:01.221599 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-8b96fae9-957e-4e7d-beee-67444befe660 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:33:01.222904 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-8b96fae9-957e-4e7d-beee-67444befe660 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:33:01.223583 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-8b96fae9-957e-4e7d-beee-67444befe660 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:33:01.227574 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-b8b36b78-2996-4120-95b2-78182d9d37d6 tempest-VolumesActionsTest-1515172499 tempest-VolumesActionsTest-1515172499-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:33:01.228343 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-b8b36b78-2996-4120-95b2-78182d9d37d6 tempest-VolumesActionsTest-1515172499 tempest-VolumesActionsTest-1515172499-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:33:01.229356 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-b8b36b78-2996-4120-95b2-78182d9d37d6 tempest-VolumesActionsTest-1515172499 tempest-VolumesActionsTest-1515172499-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:33:01.229994 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-b8b36b78-2996-4120-95b2-78182d9d37d6 tempest-VolumesActionsTest-1515172499 tempest-VolumesActionsTest-1515172499-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:33:01.746932 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-8b96fae9-957e-4e7d-beee-67444befe660 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c286a3f03048689e5ec552bb89c161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09584de3a4b14c5a90eb9b1c2149d6fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:33:01.756242 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-8b96fae9-957e-4e7d-beee-67444befe660 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] 10.222.0.18 "GET /compute/v2.1/servers/1c690e22-ec9b-423d-9f32-e01ffb3fa4b1" status: 200 len: 1521 microversion: 2.1 time: 0.557399 Jun 24 16:33:01.760386 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 85/146] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:33:01 2022] GET /compute/v2.1/servers/1c690e22-ec9b-423d-9f32-e01ffb3fa4b1 => generated 1521 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 16:33:01.767341 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-b8b36b78-2996-4120-95b2-78182d9d37d6 tempest-VolumesActionsTest-1515172499 tempest-VolumesActionsTest-1515172499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dd95251dce947f8bb6a2739a6557dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fd35a8f65244b5a18f841af49d5c7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:33:01.780525 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-b8b36b78-2996-4120-95b2-78182d9d37d6 tempest-VolumesActionsTest-1515172499 tempest-VolumesActionsTest-1515172499-project] 10.222.0.18 "GET /compute/v2.1/servers/6d4e660b-2f36-40f0-9d87-14b6146eb533" status: 200 len: 1314 microversion: 2.1 time: 0.571776 Jun 24 16:33:01.781339 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 62/147] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:33:01 2022] GET /compute/v2.1/servers/6d4e660b-2f36-40f0-9d87-14b6146eb533 => generated 1314 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 16:33:02.777577 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-6932c1c9-feba-47ac-b35e-3bfee95afab2 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Calling method '>' {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:33:02.778744 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-6932c1c9-feba-47ac-b35e-3bfee95afab2 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] [instance: 1c690e22-ec9b-423d-9f32-e01ffb3fa4b1] Fetching instance by UUID {{(pid=102148) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:33:02.804278 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-4c161c3c-69a7-463d-84ca-75b4347a1eb1 tempest-VolumesActionsTest-1515172499 tempest-VolumesActionsTest-1515172499-project] Calling method '>' {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:33:02.805316 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-6932c1c9-feba-47ac-b35e-3bfee95afab2 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:33:02.805890 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-4c161c3c-69a7-463d-84ca-75b4347a1eb1 tempest-VolumesActionsTest-1515172499 tempest-VolumesActionsTest-1515172499-project] [instance: 6d4e660b-2f36-40f0-9d87-14b6146eb533] Fetching instance by UUID {{(pid=102149) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:33:02.806090 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-6932c1c9-feba-47ac-b35e-3bfee95afab2 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:33:02.807318 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-6932c1c9-feba-47ac-b35e-3bfee95afab2 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:33:02.807983 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-6932c1c9-feba-47ac-b35e-3bfee95afab2 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:33:02.817210 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-4c161c3c-69a7-463d-84ca-75b4347a1eb1 tempest-VolumesActionsTest-1515172499 tempest-VolumesActionsTest-1515172499-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:33:02.818178 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-4c161c3c-69a7-463d-84ca-75b4347a1eb1 tempest-VolumesActionsTest-1515172499 tempest-VolumesActionsTest-1515172499-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:33:02.819920 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-4c161c3c-69a7-463d-84ca-75b4347a1eb1 tempest-VolumesActionsTest-1515172499 tempest-VolumesActionsTest-1515172499-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:33:02.820975 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-4c161c3c-69a7-463d-84ca-75b4347a1eb1 tempest-VolumesActionsTest-1515172499 tempest-VolumesActionsTest-1515172499-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:33:03.334431 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-6932c1c9-feba-47ac-b35e-3bfee95afab2 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c286a3f03048689e5ec552bb89c161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09584de3a4b14c5a90eb9b1c2149d6fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:33:03.354935 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-4c161c3c-69a7-463d-84ca-75b4347a1eb1 tempest-VolumesActionsTest-1515172499 tempest-VolumesActionsTest-1515172499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dd95251dce947f8bb6a2739a6557dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fd35a8f65244b5a18f841af49d5c7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:33:03.370949 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-6932c1c9-feba-47ac-b35e-3bfee95afab2 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] 10.222.0.18 "GET /compute/v2.1/servers/1c690e22-ec9b-423d-9f32-e01ffb3fa4b1" status: 200 len: 1521 microversion: 2.1 time: 0.600528 Jun 24 16:33:03.380970 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-4c161c3c-69a7-463d-84ca-75b4347a1eb1 tempest-VolumesActionsTest-1515172499 tempest-VolumesActionsTest-1515172499-project] 10.222.0.18 "GET /compute/v2.1/servers/6d4e660b-2f36-40f0-9d87-14b6146eb533" status: 200 len: 1497 microversion: 2.1 time: 0.582660 Jun 24 16:33:03.382332 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 63/148] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:33:02 2022] GET /compute/v2.1/servers/6d4e660b-2f36-40f0-9d87-14b6146eb533 => generated 1497 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 16:33:03.394966 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 86/149] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:33:02 2022] GET /compute/v2.1/servers/1c690e22-ec9b-423d-9f32-e01ffb3fa4b1 => generated 1521 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 16:33:04.408702 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-28aaa3d8-81d0-4852-887b-4e7ab3289010 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Calling method '>' {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:33:04.409589 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-28aaa3d8-81d0-4852-887b-4e7ab3289010 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] [instance: 1c690e22-ec9b-423d-9f32-e01ffb3fa4b1] Fetching instance by UUID {{(pid=102149) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:33:04.429834 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-28aaa3d8-81d0-4852-887b-4e7ab3289010 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:33:04.430666 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-28aaa3d8-81d0-4852-887b-4e7ab3289010 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:33:04.432865 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-28aaa3d8-81d0-4852-887b-4e7ab3289010 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:33:04.434996 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-28aaa3d8-81d0-4852-887b-4e7ab3289010 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:33:04.803078 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-28aaa3d8-81d0-4852-887b-4e7ab3289010 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c286a3f03048689e5ec552bb89c161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09584de3a4b14c5a90eb9b1c2149d6fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:33:04.812249 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-28aaa3d8-81d0-4852-887b-4e7ab3289010 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] 10.222.0.18 "GET /compute/v2.1/servers/1c690e22-ec9b-423d-9f32-e01ffb3fa4b1" status: 200 len: 1521 microversion: 2.1 time: 0.409686 Jun 24 16:33:04.812910 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 64/150] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:33:04 2022] GET /compute/v2.1/servers/1c690e22-ec9b-423d-9f32-e01ffb3fa4b1 => generated 1521 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 16:33:05.267100 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-c836ea40-38d4-442b-9ccf-c33311aae5be tempest-VolumesActionsTest-1515172499 tempest-VolumesActionsTest-1515172499-project] Calling method '>' {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:33:05.268284 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-c836ea40-38d4-442b-9ccf-c33311aae5be tempest-VolumesActionsTest-1515172499 tempest-VolumesActionsTest-1515172499-project] [instance: 6d4e660b-2f36-40f0-9d87-14b6146eb533] Fetching instance by UUID {{(pid=102148) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:33:05.281813 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-c836ea40-38d4-442b-9ccf-c33311aae5be tempest-VolumesActionsTest-1515172499 tempest-VolumesActionsTest-1515172499-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:33:05.283079 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-c836ea40-38d4-442b-9ccf-c33311aae5be tempest-VolumesActionsTest-1515172499 tempest-VolumesActionsTest-1515172499-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:33:05.284360 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-c836ea40-38d4-442b-9ccf-c33311aae5be tempest-VolumesActionsTest-1515172499 tempest-VolumesActionsTest-1515172499-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:33:05.285060 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-c836ea40-38d4-442b-9ccf-c33311aae5be tempest-VolumesActionsTest-1515172499 tempest-VolumesActionsTest-1515172499-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:33:05.418031 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-c836ea40-38d4-442b-9ccf-c33311aae5be tempest-VolumesActionsTest-1515172499 tempest-VolumesActionsTest-1515172499-project] [instance: 6d4e660b-2f36-40f0-9d87-14b6146eb533] Going to try to terminate instance {{(pid=102148) delete /opt/stack/nova/nova/compute/api.py:2562}} Jun 24 16:33:05.625727 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-c836ea40-38d4-442b-9ccf-c33311aae5be tempest-VolumesActionsTest-1515172499 tempest-VolumesActionsTest-1515172499-project] 10.222.0.18 "DELETE /compute/v2.1/servers/6d4e660b-2f36-40f0-9d87-14b6146eb533" status: 204 len: 0 microversion: 2.1 time: 0.364754 Jun 24 16:33:05.626870 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 87/151] 10.222.0.18 () {58 vars in 1238 bytes} [Fri Jun 24 16:33:05 2022] DELETE /compute/v2.1/servers/6d4e660b-2f36-40f0-9d87-14b6146eb533 => generated 0 bytes in 368 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 24 16:33:05.639438 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-7306eb9a-2b2d-473c-a32c-31e6428354bd tempest-VolumesActionsTest-1515172499 tempest-VolumesActionsTest-1515172499-project] Calling method '>' {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:33:05.640912 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-7306eb9a-2b2d-473c-a32c-31e6428354bd tempest-VolumesActionsTest-1515172499 tempest-VolumesActionsTest-1515172499-project] [instance: 6d4e660b-2f36-40f0-9d87-14b6146eb533] Fetching instance by UUID {{(pid=102149) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:33:05.653602 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-7306eb9a-2b2d-473c-a32c-31e6428354bd tempest-VolumesActionsTest-1515172499 tempest-VolumesActionsTest-1515172499-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:33:05.654624 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-7306eb9a-2b2d-473c-a32c-31e6428354bd tempest-VolumesActionsTest-1515172499 tempest-VolumesActionsTest-1515172499-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:33:05.655948 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-7306eb9a-2b2d-473c-a32c-31e6428354bd tempest-VolumesActionsTest-1515172499 tempest-VolumesActionsTest-1515172499-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:33:05.656699 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-7306eb9a-2b2d-473c-a32c-31e6428354bd tempest-VolumesActionsTest-1515172499 tempest-VolumesActionsTest-1515172499-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:33:05.836945 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-a13ffa92-d866-4f7f-8fa0-3f3725d834c8 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Calling method '>' {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:33:05.838173 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-a13ffa92-d866-4f7f-8fa0-3f3725d834c8 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] [instance: 1c690e22-ec9b-423d-9f32-e01ffb3fa4b1] Fetching instance by UUID {{(pid=102148) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:33:05.865744 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-a13ffa92-d866-4f7f-8fa0-3f3725d834c8 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:33:05.867528 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-a13ffa92-d866-4f7f-8fa0-3f3725d834c8 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:33:05.868994 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-a13ffa92-d866-4f7f-8fa0-3f3725d834c8 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:33:05.873051 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-a13ffa92-d866-4f7f-8fa0-3f3725d834c8 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:33:06.002301 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-7306eb9a-2b2d-473c-a32c-31e6428354bd tempest-VolumesActionsTest-1515172499 tempest-VolumesActionsTest-1515172499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dd95251dce947f8bb6a2739a6557dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fd35a8f65244b5a18f841af49d5c7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:33:06.022351 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-7306eb9a-2b2d-473c-a32c-31e6428354bd tempest-VolumesActionsTest-1515172499 tempest-VolumesActionsTest-1515172499-project] 10.222.0.18 "GET /compute/v2.1/servers/6d4e660b-2f36-40f0-9d87-14b6146eb533" status: 200 len: 1503 microversion: 2.1 time: 0.388049 Jun 24 16:33:06.040475 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 65/152] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:33:05 2022] GET /compute/v2.1/servers/6d4e660b-2f36-40f0-9d87-14b6146eb533 => generated 1503 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 16:33:06.220060 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-a13ffa92-d866-4f7f-8fa0-3f3725d834c8 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c286a3f03048689e5ec552bb89c161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09584de3a4b14c5a90eb9b1c2149d6fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:33:06.235076 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-a13ffa92-d866-4f7f-8fa0-3f3725d834c8 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] 10.222.0.18 "GET /compute/v2.1/servers/1c690e22-ec9b-423d-9f32-e01ffb3fa4b1" status: 200 len: 1501 microversion: 2.1 time: 0.407306 Jun 24 16:33:06.237068 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 88/153] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:33:05 2022] GET /compute/v2.1/servers/1c690e22-ec9b-423d-9f32-e01ffb3fa4b1 => generated 1501 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 16:33:06.265328 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-965e96b4-127b-4351-8795-9c733a678b2e tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Calling method '>' {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:33:06.267551 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-965e96b4-127b-4351-8795-9c733a678b2e tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] [instance: 4eb74274-8b99-455f-8f03-681fbea6b6e0] Fetching instance by UUID {{(pid=102149) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:33:06.281545 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-965e96b4-127b-4351-8795-9c733a678b2e tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:33:06.282371 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-965e96b4-127b-4351-8795-9c733a678b2e tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:33:06.283496 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-965e96b4-127b-4351-8795-9c733a678b2e tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:33:06.283945 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-965e96b4-127b-4351-8795-9c733a678b2e tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:33:06.744986 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-965e96b4-127b-4351-8795-9c733a678b2e tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c286a3f03048689e5ec552bb89c161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09584de3a4b14c5a90eb9b1c2149d6fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:33:06.758839 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-965e96b4-127b-4351-8795-9c733a678b2e tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] 10.222.0.18 "GET /compute/v2.1/servers/4eb74274-8b99-455f-8f03-681fbea6b6e0" status: 200 len: 1516 microversion: 2.1 time: 0.501733 Jun 24 16:33:06.759418 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 66/154] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:33:06 2022] GET /compute/v2.1/servers/4eb74274-8b99-455f-8f03-681fbea6b6e0 => generated 1516 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 16:33:07.047819 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-a3238ceb-3975-4f3b-ba4e-5d3e0ed4b3f2 tempest-VolumesActionsTest-1515172499 tempest-VolumesActionsTest-1515172499-project] Calling method '>' {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:33:07.049028 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-a3238ceb-3975-4f3b-ba4e-5d3e0ed4b3f2 tempest-VolumesActionsTest-1515172499 tempest-VolumesActionsTest-1515172499-project] [instance: 6d4e660b-2f36-40f0-9d87-14b6146eb533] Fetching instance by UUID {{(pid=102148) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:33:07.057250 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-a3238ceb-3975-4f3b-ba4e-5d3e0ed4b3f2 tempest-VolumesActionsTest-1515172499 tempest-VolumesActionsTest-1515172499-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:33:07.057747 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-a3238ceb-3975-4f3b-ba4e-5d3e0ed4b3f2 tempest-VolumesActionsTest-1515172499 tempest-VolumesActionsTest-1515172499-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:33:07.058525 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-a3238ceb-3975-4f3b-ba4e-5d3e0ed4b3f2 tempest-VolumesActionsTest-1515172499 tempest-VolumesActionsTest-1515172499-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:33:07.058992 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-a3238ceb-3975-4f3b-ba4e-5d3e0ed4b3f2 tempest-VolumesActionsTest-1515172499 tempest-VolumesActionsTest-1515172499-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:33:07.326230 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-a3238ceb-3975-4f3b-ba4e-5d3e0ed4b3f2 tempest-VolumesActionsTest-1515172499 tempest-VolumesActionsTest-1515172499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dd95251dce947f8bb6a2739a6557dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fd35a8f65244b5a18f841af49d5c7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:33:07.338751 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-a3238ceb-3975-4f3b-ba4e-5d3e0ed4b3f2 tempest-VolumesActionsTest-1515172499 tempest-VolumesActionsTest-1515172499-project] 10.222.0.18 "GET /compute/v2.1/servers/6d4e660b-2f36-40f0-9d87-14b6146eb533" status: 200 len: 1503 microversion: 2.1 time: 0.294332 Jun 24 16:33:07.339661 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 89/155] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:33:07 2022] GET /compute/v2.1/servers/6d4e660b-2f36-40f0-9d87-14b6146eb533 => generated 1503 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 16:33:08.367740 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-6d0e3bac-e71c-4207-9356-b9365826260b tempest-VolumesActionsTest-1515172499 tempest-VolumesActionsTest-1515172499-project] Calling method '>' {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:33:08.369087 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-6d0e3bac-e71c-4207-9356-b9365826260b tempest-VolumesActionsTest-1515172499 tempest-VolumesActionsTest-1515172499-project] [instance: 6d4e660b-2f36-40f0-9d87-14b6146eb533] Fetching instance by UUID {{(pid=102149) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:33:08.386073 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-6d0e3bac-e71c-4207-9356-b9365826260b tempest-VolumesActionsTest-1515172499 tempest-VolumesActionsTest-1515172499-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:33:08.387250 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-6d0e3bac-e71c-4207-9356-b9365826260b tempest-VolumesActionsTest-1515172499 tempest-VolumesActionsTest-1515172499-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:33:08.388862 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-6d0e3bac-e71c-4207-9356-b9365826260b tempest-VolumesActionsTest-1515172499 tempest-VolumesActionsTest-1515172499-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:33:08.389533 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-6d0e3bac-e71c-4207-9356-b9365826260b tempest-VolumesActionsTest-1515172499 tempest-VolumesActionsTest-1515172499-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:33:08.642111 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-6d0e3bac-e71c-4207-9356-b9365826260b tempest-VolumesActionsTest-1515172499 tempest-VolumesActionsTest-1515172499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dd95251dce947f8bb6a2739a6557dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fd35a8f65244b5a18f841af49d5c7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:33:08.655133 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-6d0e3bac-e71c-4207-9356-b9365826260b tempest-VolumesActionsTest-1515172499 tempest-VolumesActionsTest-1515172499-project] 10.222.0.18 "GET /compute/v2.1/servers/6d4e660b-2f36-40f0-9d87-14b6146eb533" status: 200 len: 1503 microversion: 2.1 time: 0.300025 Jun 24 16:33:08.666129 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 67/156] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:33:08 2022] GET /compute/v2.1/servers/6d4e660b-2f36-40f0-9d87-14b6146eb533 => generated 1503 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 16:33:09.677138 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-30f55be6-5261-4e03-827f-a04be73a26f5 tempest-VolumesActionsTest-1515172499 tempest-VolumesActionsTest-1515172499-project] Calling method '>' {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:33:09.677875 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-30f55be6-5261-4e03-827f-a04be73a26f5 tempest-VolumesActionsTest-1515172499 tempest-VolumesActionsTest-1515172499-project] [instance: 6d4e660b-2f36-40f0-9d87-14b6146eb533] Fetching instance by UUID {{(pid=102148) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:33:09.685903 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-30f55be6-5261-4e03-827f-a04be73a26f5 tempest-VolumesActionsTest-1515172499 tempest-VolumesActionsTest-1515172499-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:33:09.686334 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-30f55be6-5261-4e03-827f-a04be73a26f5 tempest-VolumesActionsTest-1515172499 tempest-VolumesActionsTest-1515172499-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:33:09.687128 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-30f55be6-5261-4e03-827f-a04be73a26f5 tempest-VolumesActionsTest-1515172499 tempest-VolumesActionsTest-1515172499-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:33:09.687729 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-30f55be6-5261-4e03-827f-a04be73a26f5 tempest-VolumesActionsTest-1515172499 tempest-VolumesActionsTest-1515172499-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:33:09.922226 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-30f55be6-5261-4e03-827f-a04be73a26f5 tempest-VolumesActionsTest-1515172499 tempest-VolumesActionsTest-1515172499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dd95251dce947f8bb6a2739a6557dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fd35a8f65244b5a18f841af49d5c7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:33:09.931402 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-30f55be6-5261-4e03-827f-a04be73a26f5 tempest-VolumesActionsTest-1515172499 tempest-VolumesActionsTest-1515172499-project] 10.222.0.18 "GET /compute/v2.1/servers/6d4e660b-2f36-40f0-9d87-14b6146eb533" status: 200 len: 1503 microversion: 2.1 time: 0.258441 Jun 24 16:33:09.931775 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 90/157] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:33:09 2022] GET /compute/v2.1/servers/6d4e660b-2f36-40f0-9d87-14b6146eb533 => generated 1503 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 16:33:10.951678 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-a23cd594-c071-437c-99c7-5cc130f0698b tempest-VolumesActionsTest-1515172499 tempest-VolumesActionsTest-1515172499-project] Calling method '>' {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:33:10.952966 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-a23cd594-c071-437c-99c7-5cc130f0698b tempest-VolumesActionsTest-1515172499 tempest-VolumesActionsTest-1515172499-project] [instance: 6d4e660b-2f36-40f0-9d87-14b6146eb533] Fetching instance by UUID {{(pid=102149) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:33:10.964455 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-a23cd594-c071-437c-99c7-5cc130f0698b tempest-VolumesActionsTest-1515172499 tempest-VolumesActionsTest-1515172499-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:33:10.965245 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-a23cd594-c071-437c-99c7-5cc130f0698b tempest-VolumesActionsTest-1515172499 tempest-VolumesActionsTest-1515172499-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:33:10.966661 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-a23cd594-c071-437c-99c7-5cc130f0698b tempest-VolumesActionsTest-1515172499 tempest-VolumesActionsTest-1515172499-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:33:10.967454 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-a23cd594-c071-437c-99c7-5cc130f0698b tempest-VolumesActionsTest-1515172499 tempest-VolumesActionsTest-1515172499-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:33:11.300941 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-a23cd594-c071-437c-99c7-5cc130f0698b tempest-VolumesActionsTest-1515172499 tempest-VolumesActionsTest-1515172499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dd95251dce947f8bb6a2739a6557dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fd35a8f65244b5a18f841af49d5c7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:33:11.309782 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-a23cd594-c071-437c-99c7-5cc130f0698b tempest-VolumesActionsTest-1515172499 tempest-VolumesActionsTest-1515172499-project] 10.222.0.18 "GET /compute/v2.1/servers/6d4e660b-2f36-40f0-9d87-14b6146eb533" status: 200 len: 1503 microversion: 2.1 time: 0.362955 Jun 24 16:33:11.310613 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 68/158] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:33:10 2022] GET /compute/v2.1/servers/6d4e660b-2f36-40f0-9d87-14b6146eb533 => generated 1503 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 16:33:12.331697 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-3cbbcdca-512b-4fab-ac9f-fb89bdf2e500 tempest-VolumesActionsTest-1515172499 tempest-VolumesActionsTest-1515172499-project] Calling method '>' {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:33:12.334165 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-3cbbcdca-512b-4fab-ac9f-fb89bdf2e500 tempest-VolumesActionsTest-1515172499 tempest-VolumesActionsTest-1515172499-project] [instance: 6d4e660b-2f36-40f0-9d87-14b6146eb533] Fetching instance by UUID {{(pid=102148) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:33:12.351037 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-3cbbcdca-512b-4fab-ac9f-fb89bdf2e500 tempest-VolumesActionsTest-1515172499 tempest-VolumesActionsTest-1515172499-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:33:12.352230 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-3cbbcdca-512b-4fab-ac9f-fb89bdf2e500 tempest-VolumesActionsTest-1515172499 tempest-VolumesActionsTest-1515172499-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:33:12.354492 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-3cbbcdca-512b-4fab-ac9f-fb89bdf2e500 tempest-VolumesActionsTest-1515172499 tempest-VolumesActionsTest-1515172499-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:33:12.355726 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-3cbbcdca-512b-4fab-ac9f-fb89bdf2e500 tempest-VolumesActionsTest-1515172499 tempest-VolumesActionsTest-1515172499-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:33:12.862172 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-769ffb06-e494-444e-b3ad-9fc0c5d213e4 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 16:33:12.865018 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-769ffb06-e494-444e-b3ad-9fc0c5d213e4 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] [instance: 4eb74274-8b99-455f-8f03-681fbea6b6e0] Fetching instance by UUID {{(pid=102149) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:33:12.879461 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-769ffb06-e494-444e-b3ad-9fc0c5d213e4 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:33:12.880399 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-769ffb06-e494-444e-b3ad-9fc0c5d213e4 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:33:12.882005 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-769ffb06-e494-444e-b3ad-9fc0c5d213e4 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:33:12.882784 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-769ffb06-e494-444e-b3ad-9fc0c5d213e4 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:33:12.959049 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.objects.instance [None req-769ffb06-e494-444e-b3ad-9fc0c5d213e4 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lazy-loading 'flavor' on Instance uuid 4eb74274-8b99-455f-8f03-681fbea6b6e0 {{(pid=102149) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Jun 24 16:33:13.037682 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-3cbbcdca-512b-4fab-ac9f-fb89bdf2e500 tempest-VolumesActionsTest-1515172499 tempest-VolumesActionsTest-1515172499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dd95251dce947f8bb6a2739a6557dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fd35a8f65244b5a18f841af49d5c7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:33:13.054495 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-3cbbcdca-512b-4fab-ac9f-fb89bdf2e500 tempest-VolumesActionsTest-1515172499 tempest-VolumesActionsTest-1515172499-project] 10.222.0.18 "GET /compute/v2.1/servers/6d4e660b-2f36-40f0-9d87-14b6146eb533" status: 200 len: 1503 microversion: 2.1 time: 0.727682 Jun 24 16:33:13.064917 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 91/159] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:33:12 2022] GET /compute/v2.1/servers/6d4e660b-2f36-40f0-9d87-14b6146eb533 => generated 1503 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 16:33:13.250152 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-769ffb06-e494-444e-b3ad-9fc0c5d213e4 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] 10.222.0.18 "POST /compute/v2.1/servers/4eb74274-8b99-455f-8f03-681fbea6b6e0/action" status: 200 len: 32 microversion: 2.1 time: 0.395458 Jun 24 16:33:13.251484 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 69/160] 10.222.0.18 () {60 vars in 1277 bytes} [Fri Jun 24 16:33:12 2022] POST /compute/v2.1/servers/4eb74274-8b99-455f-8f03-681fbea6b6e0/action => generated 32 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 24 16:33:13.265509 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-33ce237f-806c-4dba-9d6c-0687752b2523 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Calling method '>' {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:33:13.266130 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-33ce237f-806c-4dba-9d6c-0687752b2523 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] [instance: 4eb74274-8b99-455f-8f03-681fbea6b6e0] Fetching instance by UUID {{(pid=102148) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:33:13.300770 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-33ce237f-806c-4dba-9d6c-0687752b2523 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:33:13.301137 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-33ce237f-806c-4dba-9d6c-0687752b2523 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:33:13.301962 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-33ce237f-806c-4dba-9d6c-0687752b2523 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:33:13.302403 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-33ce237f-806c-4dba-9d6c-0687752b2523 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:33:13.679340 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [req-5add84af-f85a-4692-8424-e5197f2c8aba req-46fe8cd3-204e-498e-9a26-1d1c22a6a78b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6d4e660b-2f36-40f0-9d87-14b6146eb533", "name": "network-vif-deleted", "tag": "eee1df7d-b70e-4fac-bc05-3f41f73577d9"}]} {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 16:33:13.681762 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 24 16:33:13.681762 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: warnings.warn(msg) Jun 24 16:33:13.698031 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [req-5add84af-f85a-4692-8424-e5197f2c8aba req-46fe8cd3-204e-498e-9a26-1d1c22a6a78b service nova] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:33:13.699141 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [req-5add84af-f85a-4692-8424-e5197f2c8aba req-46fe8cd3-204e-498e-9a26-1d1c22a6a78b service nova] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:33:13.732717 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.compute.server_external_events [req-5add84af-f85a-4692-8424-e5197f2c8aba req-46fe8cd3-204e-498e-9a26-1d1c22a6a78b service nova] Creating event network-vif-deleted:eee1df7d-b70e-4fac-bc05-3f41f73577d9 for instance 6d4e660b-2f36-40f0-9d87-14b6146eb533 on hv-cinder-84718 Jun 24 16:33:13.739752 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [req-5add84af-f85a-4692-8424-e5197f2c8aba req-46fe8cd3-204e-498e-9a26-1d1c22a6a78b service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069446 Jun 24 16:33:13.742235 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 70/161] 10.222.0.18 () {64 vars in 1317 bytes} [Fri Jun 24 16:33:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 16:33:13.841271 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-33ce237f-806c-4dba-9d6c-0687752b2523 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c286a3f03048689e5ec552bb89c161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09584de3a4b14c5a90eb9b1c2149d6fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:33:13.866732 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-33ce237f-806c-4dba-9d6c-0687752b2523 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] 10.222.0.18 "GET /compute/v2.1/servers/4eb74274-8b99-455f-8f03-681fbea6b6e0" status: 200 len: 1522 microversion: 2.1 time: 0.609420 Jun 24 16:33:13.872162 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 92/162] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:33:13 2022] GET /compute/v2.1/servers/4eb74274-8b99-455f-8f03-681fbea6b6e0 => generated 1522 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 16:33:14.077154 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-45766477-5758-4c6d-88b5-211a364325b0 tempest-VolumesActionsTest-1515172499 tempest-VolumesActionsTest-1515172499-project] Calling method '>' {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:33:14.078020 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-45766477-5758-4c6d-88b5-211a364325b0 tempest-VolumesActionsTest-1515172499 tempest-VolumesActionsTest-1515172499-project] [instance: 6d4e660b-2f36-40f0-9d87-14b6146eb533] Fetching instance by UUID {{(pid=102149) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:33:14.088889 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-45766477-5758-4c6d-88b5-211a364325b0 tempest-VolumesActionsTest-1515172499 tempest-VolumesActionsTest-1515172499-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:33:14.089493 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-45766477-5758-4c6d-88b5-211a364325b0 tempest-VolumesActionsTest-1515172499 tempest-VolumesActionsTest-1515172499-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:33:14.090361 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-45766477-5758-4c6d-88b5-211a364325b0 tempest-VolumesActionsTest-1515172499 tempest-VolumesActionsTest-1515172499-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:33:14.091020 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-45766477-5758-4c6d-88b5-211a364325b0 tempest-VolumesActionsTest-1515172499 tempest-VolumesActionsTest-1515172499-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:33:14.180524 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-45766477-5758-4c6d-88b5-211a364325b0 tempest-VolumesActionsTest-1515172499 tempest-VolumesActionsTest-1515172499-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:33:14.181370 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-45766477-5758-4c6d-88b5-211a364325b0 tempest-VolumesActionsTest-1515172499 tempest-VolumesActionsTest-1515172499-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:33:14.182051 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.objects.instance [None req-45766477-5758-4c6d-88b5-211a364325b0 tempest-VolumesActionsTest-1515172499 tempest-VolumesActionsTest-1515172499-project] Lazy-loading 'fault' on Instance uuid 6d4e660b-2f36-40f0-9d87-14b6146eb533 {{(pid=102149) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Jun 24 16:33:14.327036 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-45766477-5758-4c6d-88b5-211a364325b0 tempest-VolumesActionsTest-1515172499 tempest-VolumesActionsTest-1515172499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dd95251dce947f8bb6a2739a6557dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fd35a8f65244b5a18f841af49d5c7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:33:14.342651 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-45766477-5758-4c6d-88b5-211a364325b0 tempest-VolumesActionsTest-1515172499 tempest-VolumesActionsTest-1515172499-project] 10.222.0.18 "GET /compute/v2.1/servers/6d4e660b-2f36-40f0-9d87-14b6146eb533" status: 200 len: 1304 microversion: 2.1 time: 0.269974 Jun 24 16:33:14.343807 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 71/163] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:33:14 2022] GET /compute/v2.1/servers/6d4e660b-2f36-40f0-9d87-14b6146eb533 => generated 1304 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 16:33:14.895917 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-36db91a1-b0e4-4268-8323-a1c2104dcd27 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Calling method '>' {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:33:14.898463 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-36db91a1-b0e4-4268-8323-a1c2104dcd27 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] [instance: 4eb74274-8b99-455f-8f03-681fbea6b6e0] Fetching instance by UUID {{(pid=102148) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:33:14.912797 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-36db91a1-b0e4-4268-8323-a1c2104dcd27 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:33:14.913453 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-36db91a1-b0e4-4268-8323-a1c2104dcd27 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:33:14.914798 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-36db91a1-b0e4-4268-8323-a1c2104dcd27 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:33:14.915663 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-36db91a1-b0e4-4268-8323-a1c2104dcd27 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:33:15.364222 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-36db91a1-b0e4-4268-8323-a1c2104dcd27 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c286a3f03048689e5ec552bb89c161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09584de3a4b14c5a90eb9b1c2149d6fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:33:15.369493 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-2293c87d-a00e-4168-aa5f-96dba44c4276 tempest-VolumesActionsTest-1515172499 tempest-VolumesActionsTest-1515172499-project] Calling method '>' {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:33:15.371099 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-2293c87d-a00e-4168-aa5f-96dba44c4276 tempest-VolumesActionsTest-1515172499 tempest-VolumesActionsTest-1515172499-project] [instance: 6d4e660b-2f36-40f0-9d87-14b6146eb533] Fetching instance by UUID {{(pid=102149) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:33:15.376809 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-36db91a1-b0e4-4268-8323-a1c2104dcd27 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] 10.222.0.18 "GET /compute/v2.1/servers/4eb74274-8b99-455f-8f03-681fbea6b6e0" status: 200 len: 1522 microversion: 2.1 time: 0.487340 Jun 24 16:33:15.386046 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 93/164] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:33:14 2022] GET /compute/v2.1/servers/4eb74274-8b99-455f-8f03-681fbea6b6e0 => generated 1522 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 16:33:15.401790 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-2293c87d-a00e-4168-aa5f-96dba44c4276 tempest-VolumesActionsTest-1515172499 tempest-VolumesActionsTest-1515172499-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:33:15.403938 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-2293c87d-a00e-4168-aa5f-96dba44c4276 tempest-VolumesActionsTest-1515172499 tempest-VolumesActionsTest-1515172499-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:33:15.408053 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-2293c87d-a00e-4168-aa5f-96dba44c4276 tempest-VolumesActionsTest-1515172499 tempest-VolumesActionsTest-1515172499-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:33:15.409509 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-2293c87d-a00e-4168-aa5f-96dba44c4276 tempest-VolumesActionsTest-1515172499 tempest-VolumesActionsTest-1515172499-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:33:15.565518 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.wsgi [None req-2293c87d-a00e-4168-aa5f-96dba44c4276 tempest-VolumesActionsTest-1515172499 tempest-VolumesActionsTest-1515172499-project] HTTP exception thrown: Instance 6d4e660b-2f36-40f0-9d87-14b6146eb533 could not be found. Jun 24 16:33:15.567522 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-2293c87d-a00e-4168-aa5f-96dba44c4276 tempest-VolumesActionsTest-1515172499 tempest-VolumesActionsTest-1515172499-project] Returning 404 to user: Instance 6d4e660b-2f36-40f0-9d87-14b6146eb533 could not be found. {{(pid=102149) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jun 24 16:33:15.569184 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-2293c87d-a00e-4168-aa5f-96dba44c4276 tempest-VolumesActionsTest-1515172499 tempest-VolumesActionsTest-1515172499-project] 10.222.0.18 "GET /compute/v2.1/servers/6d4e660b-2f36-40f0-9d87-14b6146eb533" status: 404 len: 111 microversion: 2.1 time: 0.208153 Jun 24 16:33:15.577107 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 72/165] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:33:15 2022] GET /compute/v2.1/servers/6d4e660b-2f36-40f0-9d87-14b6146eb533 => generated 111 bytes in 218 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 24 16:33:15.771973 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-cc978621-6942-4997-9466-44d3099b2a17 tempest-VolumesActionsTest-1515172499 tempest-VolumesActionsTest-1515172499-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1186019624", "imageRef": "113c9cfb-6cee-4018-9e63-66fae82b3851", "flavorRef": "452", "networks": [{"uuid": "122001b6-bbce-455c-bf04-68783d81a89e"}]}} {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 16:33:15.970729 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.network.neutron [None req-cc978621-6942-4997-9466-44d3099b2a17 tempest-VolumesActionsTest-1515172499 tempest-VolumesActionsTest-1515172499-project] validate_networks() for [('122001b6-bbce-455c-bf04-68783d81a89e', None, None, None)] {{(pid=102148) validate_networks /opt/stack/nova/nova/network/neutron.py:2367}} Jun 24 16:33:16.404875 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-15d37e52-4208-4a1b-a760-18d52a87fd62 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Calling method '>' {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:33:16.405837 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-15d37e52-4208-4a1b-a760-18d52a87fd62 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] [instance: 4eb74274-8b99-455f-8f03-681fbea6b6e0] Fetching instance by UUID {{(pid=102149) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:33:16.418052 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-15d37e52-4208-4a1b-a760-18d52a87fd62 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:33:16.418619 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-15d37e52-4208-4a1b-a760-18d52a87fd62 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:33:16.419763 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-15d37e52-4208-4a1b-a760-18d52a87fd62 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:33:16.420331 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-15d37e52-4208-4a1b-a760-18d52a87fd62 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:33:17.029471 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-15d37e52-4208-4a1b-a760-18d52a87fd62 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c286a3f03048689e5ec552bb89c161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09584de3a4b14c5a90eb9b1c2149d6fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:33:17.047372 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-15d37e52-4208-4a1b-a760-18d52a87fd62 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] 10.222.0.18 "GET /compute/v2.1/servers/4eb74274-8b99-455f-8f03-681fbea6b6e0" status: 200 len: 1522 microversion: 2.1 time: 0.648080 Jun 24 16:33:17.049504 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 73/166] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:33:16 2022] GET /compute/v2.1/servers/4eb74274-8b99-455f-8f03-681fbea6b6e0 => generated 1522 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 16:33:17.057640 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.virt.hardware [None req-cc978621-6942-4997-9466-44d3099b2a17 tempest-VolumesActionsTest-1515172499 tempest-VolumesActionsTest-1515172499-project] Flavor limits 0:0:0 {{(pid=102148) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 24 16:33:17.058362 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.virt.hardware [None req-cc978621-6942-4997-9466-44d3099b2a17 tempest-VolumesActionsTest-1515172499 tempest-VolumesActionsTest-1515172499-project] Image limits 0:0:0 {{(pid=102148) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 24 16:33:17.059541 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.virt.hardware [None req-cc978621-6942-4997-9466-44d3099b2a17 tempest-VolumesActionsTest-1515172499 tempest-VolumesActionsTest-1515172499-project] Flavor pref 0:0:0 {{(pid=102148) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 24 16:33:17.060415 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.virt.hardware [None req-cc978621-6942-4997-9466-44d3099b2a17 tempest-VolumesActionsTest-1515172499 tempest-VolumesActionsTest-1515172499-project] Image pref 0:0:0 {{(pid=102148) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 24 16:33:17.060912 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.virt.hardware [None req-cc978621-6942-4997-9466-44d3099b2a17 tempest-VolumesActionsTest-1515172499 tempest-VolumesActionsTest-1515172499-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=102148) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 24 16:33:17.075375 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-cc978621-6942-4997-9466-44d3099b2a17 tempest-VolumesActionsTest-1515172499 tempest-VolumesActionsTest-1515172499-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:33:17.076681 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-cc978621-6942-4997-9466-44d3099b2a17 tempest-VolumesActionsTest-1515172499 tempest-VolumesActionsTest-1515172499-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:33:17.078384 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-cc978621-6942-4997-9466-44d3099b2a17 tempest-VolumesActionsTest-1515172499 tempest-VolumesActionsTest-1515172499-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:33:17.079879 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-cc978621-6942-4997-9466-44d3099b2a17 tempest-VolumesActionsTest-1515172499 tempest-VolumesActionsTest-1515172499-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:33:17.111938 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.quota [None req-cc978621-6942-4997-9466-44d3099b2a17 tempest-VolumesActionsTest-1515172499 tempest-VolumesActionsTest-1515172499-project] Getting quotas for project 55fd35a8f65244b5a18f841af49d5c7d. Resources: {'ram', 'instances', 'cores'} {{(pid=102148) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jun 24 16:33:17.118286 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.quota [None req-cc978621-6942-4997-9466-44d3099b2a17 tempest-VolumesActionsTest-1515172499 tempest-VolumesActionsTest-1515172499-project] Getting quotas for user 8dd95251dce947f8bb6a2739a6557dfe and project 55fd35a8f65244b5a18f841af49d5c7d. Resources: {'ram', 'instances', 'cores'} {{(pid=102148) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jun 24 16:33:17.131856 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-cc978621-6942-4997-9466-44d3099b2a17 tempest-VolumesActionsTest-1515172499 tempest-VolumesActionsTest-1515172499-project] Going to run 1 instances... {{(pid=102148) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Jun 24 16:33:17.135774 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-cc978621-6942-4997-9466-44d3099b2a17 tempest-VolumesActionsTest-1515172499 tempest-VolumesActionsTest-1515172499-project] [instance: 2941738f-8dec-4faa-99e4-aca0a28b71e6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='113c9cfb-6cee-4018-9e63-66fae82b3851',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=102148) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1684}} Jun 24 16:33:17.211135 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-cc978621-6942-4997-9466-44d3099b2a17 tempest-VolumesActionsTest-1515172499 tempest-VolumesActionsTest-1515172499-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.447447 Jun 24 16:33:17.211976 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 94/167] 10.222.0.18 () {60 vars in 1146 bytes} [Fri Jun 24 16:33:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 1450 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 24 16:33:17.226411 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-5880488b-31d9-4943-83d1-e28cb285df5d tempest-VolumesActionsTest-1515172499 tempest-VolumesActionsTest-1515172499-project] Calling method '>' {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:33:17.227583 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-5880488b-31d9-4943-83d1-e28cb285df5d tempest-VolumesActionsTest-1515172499 tempest-VolumesActionsTest-1515172499-project] [instance: 2941738f-8dec-4faa-99e4-aca0a28b71e6] Fetching instance by UUID {{(pid=102149) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:33:17.332878 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-5880488b-31d9-4943-83d1-e28cb285df5d tempest-VolumesActionsTest-1515172499 tempest-VolumesActionsTest-1515172499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dd95251dce947f8bb6a2739a6557dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fd35a8f65244b5a18f841af49d5c7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:33:17.341674 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-5880488b-31d9-4943-83d1-e28cb285df5d tempest-VolumesActionsTest-1515172499 tempest-VolumesActionsTest-1515172499-project] 10.222.0.18 "GET /compute/v2.1/servers/2941738f-8dec-4faa-99e4-aca0a28b71e6" status: 200 len: 1214 microversion: 2.1 time: 0.119900 Jun 24 16:33:17.356492 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 74/168] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:33:17 2022] GET /compute/v2.1/servers/2941738f-8dec-4faa-99e4-aca0a28b71e6 => generated 1214 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 16:33:18.065673 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-5dc2d27c-5aaf-4414-ac6b-24ebea3c5d4b tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Calling method '>' {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:33:18.066485 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-5dc2d27c-5aaf-4414-ac6b-24ebea3c5d4b tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] [instance: 4eb74274-8b99-455f-8f03-681fbea6b6e0] Fetching instance by UUID {{(pid=102148) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:33:18.083912 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-5dc2d27c-5aaf-4414-ac6b-24ebea3c5d4b tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:33:18.084711 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-5dc2d27c-5aaf-4414-ac6b-24ebea3c5d4b tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:33:18.085825 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-5dc2d27c-5aaf-4414-ac6b-24ebea3c5d4b tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:33:18.098441 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-5dc2d27c-5aaf-4414-ac6b-24ebea3c5d4b tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:33:18.364214 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-af96af48-e1c9-4b61-aac5-e2d058613910 tempest-VolumesActionsTest-1515172499 tempest-VolumesActionsTest-1515172499-project] Calling method '>' {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:33:18.366080 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-af96af48-e1c9-4b61-aac5-e2d058613910 tempest-VolumesActionsTest-1515172499 tempest-VolumesActionsTest-1515172499-project] [instance: 2941738f-8dec-4faa-99e4-aca0a28b71e6] Fetching instance by UUID {{(pid=102149) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:33:18.389914 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-af96af48-e1c9-4b61-aac5-e2d058613910 tempest-VolumesActionsTest-1515172499 tempest-VolumesActionsTest-1515172499-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:33:18.393231 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-af96af48-e1c9-4b61-aac5-e2d058613910 tempest-VolumesActionsTest-1515172499 tempest-VolumesActionsTest-1515172499-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:33:18.397957 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-af96af48-e1c9-4b61-aac5-e2d058613910 tempest-VolumesActionsTest-1515172499 tempest-VolumesActionsTest-1515172499-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:33:18.401229 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-af96af48-e1c9-4b61-aac5-e2d058613910 tempest-VolumesActionsTest-1515172499 tempest-VolumesActionsTest-1515172499-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:33:18.585380 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-5dc2d27c-5aaf-4414-ac6b-24ebea3c5d4b tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c286a3f03048689e5ec552bb89c161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09584de3a4b14c5a90eb9b1c2149d6fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:33:18.602941 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-5dc2d27c-5aaf-4414-ac6b-24ebea3c5d4b tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] 10.222.0.18 "GET /compute/v2.1/servers/4eb74274-8b99-455f-8f03-681fbea6b6e0" status: 200 len: 1522 microversion: 2.1 time: 0.540788 Jun 24 16:33:18.604330 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 95/169] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:33:18 2022] GET /compute/v2.1/servers/4eb74274-8b99-455f-8f03-681fbea6b6e0 => generated 1522 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 16:33:18.689779 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-af96af48-e1c9-4b61-aac5-e2d058613910 tempest-VolumesActionsTest-1515172499 tempest-VolumesActionsTest-1515172499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dd95251dce947f8bb6a2739a6557dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fd35a8f65244b5a18f841af49d5c7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:33:18.706773 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-af96af48-e1c9-4b61-aac5-e2d058613910 tempest-VolumesActionsTest-1515172499 tempest-VolumesActionsTest-1515172499-project] 10.222.0.18 "GET /compute/v2.1/servers/2941738f-8dec-4faa-99e4-aca0a28b71e6" status: 200 len: 1266 microversion: 2.1 time: 0.347593 Jun 24 16:33:18.709074 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 75/170] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:33:18 2022] GET /compute/v2.1/servers/2941738f-8dec-4faa-99e4-aca0a28b71e6 => generated 1266 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 16:33:19.641685 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-319c33be-2f2e-42b4-9278-4a8d48abaaae tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Calling method '>' {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:33:19.644788 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-319c33be-2f2e-42b4-9278-4a8d48abaaae tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] [instance: 4eb74274-8b99-455f-8f03-681fbea6b6e0] Fetching instance by UUID {{(pid=102148) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:33:19.667216 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-319c33be-2f2e-42b4-9278-4a8d48abaaae tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:33:19.667817 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-319c33be-2f2e-42b4-9278-4a8d48abaaae tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:33:19.669014 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-319c33be-2f2e-42b4-9278-4a8d48abaaae tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:33:19.669635 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-319c33be-2f2e-42b4-9278-4a8d48abaaae tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:33:19.731402 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-8f91295a-183b-467a-b0d3-76f7054148e8 tempest-VolumesActionsTest-1515172499 tempest-VolumesActionsTest-1515172499-project] Calling method '>' {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:33:19.733388 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-8f91295a-183b-467a-b0d3-76f7054148e8 tempest-VolumesActionsTest-1515172499 tempest-VolumesActionsTest-1515172499-project] [instance: 2941738f-8dec-4faa-99e4-aca0a28b71e6] Fetching instance by UUID {{(pid=102149) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:33:19.753143 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-8f91295a-183b-467a-b0d3-76f7054148e8 tempest-VolumesActionsTest-1515172499 tempest-VolumesActionsTest-1515172499-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:33:19.754982 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-8f91295a-183b-467a-b0d3-76f7054148e8 tempest-VolumesActionsTest-1515172499 tempest-VolumesActionsTest-1515172499-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:33:19.756859 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-8f91295a-183b-467a-b0d3-76f7054148e8 tempest-VolumesActionsTest-1515172499 tempest-VolumesActionsTest-1515172499-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:33:19.757938 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-8f91295a-183b-467a-b0d3-76f7054148e8 tempest-VolumesActionsTest-1515172499 tempest-VolumesActionsTest-1515172499-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:33:20.182026 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-8f91295a-183b-467a-b0d3-76f7054148e8 tempest-VolumesActionsTest-1515172499 tempest-VolumesActionsTest-1515172499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dd95251dce947f8bb6a2739a6557dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fd35a8f65244b5a18f841af49d5c7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:33:20.205819 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-8f91295a-183b-467a-b0d3-76f7054148e8 tempest-VolumesActionsTest-1515172499 tempest-VolumesActionsTest-1515172499-project] 10.222.0.18 "GET /compute/v2.1/servers/2941738f-8dec-4faa-99e4-aca0a28b71e6" status: 200 len: 1272 microversion: 2.1 time: 0.481277 Jun 24 16:33:20.207212 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 76/171] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:33:19 2022] GET /compute/v2.1/servers/2941738f-8dec-4faa-99e4-aca0a28b71e6 => generated 1272 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 16:33:20.418267 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-319c33be-2f2e-42b4-9278-4a8d48abaaae tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c286a3f03048689e5ec552bb89c161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09584de3a4b14c5a90eb9b1c2149d6fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:33:20.445986 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-319c33be-2f2e-42b4-9278-4a8d48abaaae tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] 10.222.0.18 "GET /compute/v2.1/servers/4eb74274-8b99-455f-8f03-681fbea6b6e0" status: 200 len: 1522 microversion: 2.1 time: 0.814011 Jun 24 16:33:20.449599 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 96/172] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:33:19 2022] GET /compute/v2.1/servers/4eb74274-8b99-455f-8f03-681fbea6b6e0 => generated 1522 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 16:33:21.236519 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-2a4d215b-23f9-4a4f-be9a-5ad8b9e802ae tempest-VolumesActionsTest-1515172499 tempest-VolumesActionsTest-1515172499-project] Calling method '>' {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:33:21.239968 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-2a4d215b-23f9-4a4f-be9a-5ad8b9e802ae tempest-VolumesActionsTest-1515172499 tempest-VolumesActionsTest-1515172499-project] [instance: 2941738f-8dec-4faa-99e4-aca0a28b71e6] Fetching instance by UUID {{(pid=102149) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:33:21.269967 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-2a4d215b-23f9-4a4f-be9a-5ad8b9e802ae tempest-VolumesActionsTest-1515172499 tempest-VolumesActionsTest-1515172499-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:33:21.270782 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-2a4d215b-23f9-4a4f-be9a-5ad8b9e802ae tempest-VolumesActionsTest-1515172499 tempest-VolumesActionsTest-1515172499-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:33:21.280182 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-2a4d215b-23f9-4a4f-be9a-5ad8b9e802ae tempest-VolumesActionsTest-1515172499 tempest-VolumesActionsTest-1515172499-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:33:21.281200 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-2a4d215b-23f9-4a4f-be9a-5ad8b9e802ae tempest-VolumesActionsTest-1515172499 tempest-VolumesActionsTest-1515172499-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:33:21.466334 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-f4af40eb-5fb2-4c44-9d96-9b36dbd009db tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Calling method '>' {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:33:21.467083 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-f4af40eb-5fb2-4c44-9d96-9b36dbd009db tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] [instance: 4eb74274-8b99-455f-8f03-681fbea6b6e0] Fetching instance by UUID {{(pid=102148) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:33:21.480441 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-f4af40eb-5fb2-4c44-9d96-9b36dbd009db tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:33:21.480794 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-f4af40eb-5fb2-4c44-9d96-9b36dbd009db tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:33:21.481618 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-f4af40eb-5fb2-4c44-9d96-9b36dbd009db tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:33:21.482066 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-f4af40eb-5fb2-4c44-9d96-9b36dbd009db tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:33:21.991821 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-f4af40eb-5fb2-4c44-9d96-9b36dbd009db tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c286a3f03048689e5ec552bb89c161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09584de3a4b14c5a90eb9b1c2149d6fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:33:22.004655 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-2a4d215b-23f9-4a4f-be9a-5ad8b9e802ae tempest-VolumesActionsTest-1515172499 tempest-VolumesActionsTest-1515172499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dd95251dce947f8bb6a2739a6557dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fd35a8f65244b5a18f841af49d5c7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:33:22.020817 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-f4af40eb-5fb2-4c44-9d96-9b36dbd009db tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] 10.222.0.18 "GET /compute/v2.1/servers/4eb74274-8b99-455f-8f03-681fbea6b6e0" status: 200 len: 1522 microversion: 2.1 time: 0.558298 Jun 24 16:33:22.021410 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 97/173] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:33:21 2022] GET /compute/v2.1/servers/4eb74274-8b99-455f-8f03-681fbea6b6e0 => generated 1522 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 16:33:22.024079 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-2a4d215b-23f9-4a4f-be9a-5ad8b9e802ae tempest-VolumesActionsTest-1515172499 tempest-VolumesActionsTest-1515172499-project] 10.222.0.18 "GET /compute/v2.1/servers/2941738f-8dec-4faa-99e4-aca0a28b71e6" status: 200 len: 1314 microversion: 2.1 time: 0.795149 Jun 24 16:33:22.026330 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 77/174] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:33:21 2022] GET /compute/v2.1/servers/2941738f-8dec-4faa-99e4-aca0a28b71e6 => generated 1314 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 16:33:23.068005 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-7834296e-ffd7-4861-bf9d-a71d1074fae6 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Calling method '>' {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:33:23.068627 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-7834296e-ffd7-4861-bf9d-a71d1074fae6 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] [instance: 4eb74274-8b99-455f-8f03-681fbea6b6e0] Fetching instance by UUID {{(pid=102148) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:33:23.071260 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-350a21de-02cc-432f-87dc-f3899a29661a tempest-VolumesActionsTest-1515172499 tempest-VolumesActionsTest-1515172499-project] Calling method '>' {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:33:23.072286 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-350a21de-02cc-432f-87dc-f3899a29661a tempest-VolumesActionsTest-1515172499 tempest-VolumesActionsTest-1515172499-project] [instance: 2941738f-8dec-4faa-99e4-aca0a28b71e6] Fetching instance by UUID {{(pid=102149) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:33:23.089780 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-7834296e-ffd7-4861-bf9d-a71d1074fae6 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:33:23.093125 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-350a21de-02cc-432f-87dc-f3899a29661a tempest-VolumesActionsTest-1515172499 tempest-VolumesActionsTest-1515172499-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:33:23.094411 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-7834296e-ffd7-4861-bf9d-a71d1074fae6 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:33:23.096269 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-7834296e-ffd7-4861-bf9d-a71d1074fae6 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:33:23.097622 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-350a21de-02cc-432f-87dc-f3899a29661a tempest-VolumesActionsTest-1515172499 tempest-VolumesActionsTest-1515172499-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:33:23.099799 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-7834296e-ffd7-4861-bf9d-a71d1074fae6 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:33:23.101487 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-350a21de-02cc-432f-87dc-f3899a29661a tempest-VolumesActionsTest-1515172499 tempest-VolumesActionsTest-1515172499-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:33:23.112181 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-350a21de-02cc-432f-87dc-f3899a29661a tempest-VolumesActionsTest-1515172499 tempest-VolumesActionsTest-1515172499-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:33:24.189001 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-7834296e-ffd7-4861-bf9d-a71d1074fae6 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c286a3f03048689e5ec552bb89c161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09584de3a4b14c5a90eb9b1c2149d6fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:33:24.217247 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-7834296e-ffd7-4861-bf9d-a71d1074fae6 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] 10.222.0.18 "GET /compute/v2.1/servers/4eb74274-8b99-455f-8f03-681fbea6b6e0" status: 200 len: 1522 microversion: 2.1 time: 1.169819 Jun 24 16:33:24.219421 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 98/175] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:33:23 2022] GET /compute/v2.1/servers/4eb74274-8b99-455f-8f03-681fbea6b6e0 => generated 1522 bytes in 1175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 16:33:24.271691 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [req-35040655-db95-40cd-a2b8-97b69383cffd req-8d0b8c4d-2b9f-40c9-a759-1629d812afc2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2941738f-8dec-4faa-99e4-aca0a28b71e6", "tag": "ea66b455-fbf3-476e-94fe-b88e627a3c9c"}]} {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 16:33:24.280892 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-350a21de-02cc-432f-87dc-f3899a29661a tempest-VolumesActionsTest-1515172499 tempest-VolumesActionsTest-1515172499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dd95251dce947f8bb6a2739a6557dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fd35a8f65244b5a18f841af49d5c7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:33:24.283366 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 24 16:33:24.283366 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: warnings.warn(msg) Jun 24 16:33:24.301017 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-350a21de-02cc-432f-87dc-f3899a29661a tempest-VolumesActionsTest-1515172499 tempest-VolumesActionsTest-1515172499-project] 10.222.0.18 "GET /compute/v2.1/servers/2941738f-8dec-4faa-99e4-aca0a28b71e6" status: 200 len: 1314 microversion: 2.1 time: 1.251148 Jun 24 16:33:24.302179 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 78/176] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:33:23 2022] GET /compute/v2.1/servers/2941738f-8dec-4faa-99e4-aca0a28b71e6 => generated 1314 bytes in 1257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 16:33:24.326607 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [req-35040655-db95-40cd-a2b8-97b69383cffd req-8d0b8c4d-2b9f-40c9-a759-1629d812afc2 service nova] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:33:24.327706 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [req-35040655-db95-40cd-a2b8-97b69383cffd req-8d0b8c4d-2b9f-40c9-a759-1629d812afc2 service nova] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:33:24.384329 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.compute.server_external_events [req-35040655-db95-40cd-a2b8-97b69383cffd req-8d0b8c4d-2b9f-40c9-a759-1629d812afc2 service nova] Creating event network-changed:ea66b455-fbf3-476e-94fe-b88e627a3c9c for instance 2941738f-8dec-4faa-99e4-aca0a28b71e6 on hv-cinder-84718 Jun 24 16:33:24.389775 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [req-35040655-db95-40cd-a2b8-97b69383cffd req-8d0b8c4d-2b9f-40c9-a759-1629d812afc2 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.167259 Jun 24 16:33:24.391577 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 99/177] 10.222.0.18 () {64 vars in 1317 bytes} [Fri Jun 24 16:33:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 16:33:25.251105 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-845835aa-cbd9-45c9-b171-2f822e67aefe tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Calling method '>' {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:33:25.252072 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-845835aa-cbd9-45c9-b171-2f822e67aefe tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] [instance: 4eb74274-8b99-455f-8f03-681fbea6b6e0] Fetching instance by UUID {{(pid=102149) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:33:25.264984 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-845835aa-cbd9-45c9-b171-2f822e67aefe tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:33:25.268604 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-845835aa-cbd9-45c9-b171-2f822e67aefe tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:33:25.269555 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-845835aa-cbd9-45c9-b171-2f822e67aefe tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:33:25.270006 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-845835aa-cbd9-45c9-b171-2f822e67aefe tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:33:25.322846 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-afbf2fc7-6da5-4b72-830c-bee405072778 tempest-VolumesActionsTest-1515172499 tempest-VolumesActionsTest-1515172499-project] Calling method '>' {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:33:25.330324 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-afbf2fc7-6da5-4b72-830c-bee405072778 tempest-VolumesActionsTest-1515172499 tempest-VolumesActionsTest-1515172499-project] [instance: 2941738f-8dec-4faa-99e4-aca0a28b71e6] Fetching instance by UUID {{(pid=102148) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:33:25.362967 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-afbf2fc7-6da5-4b72-830c-bee405072778 tempest-VolumesActionsTest-1515172499 tempest-VolumesActionsTest-1515172499-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:33:25.364310 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-afbf2fc7-6da5-4b72-830c-bee405072778 tempest-VolumesActionsTest-1515172499 tempest-VolumesActionsTest-1515172499-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:33:25.369631 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-afbf2fc7-6da5-4b72-830c-bee405072778 tempest-VolumesActionsTest-1515172499 tempest-VolumesActionsTest-1515172499-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:33:25.374874 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-afbf2fc7-6da5-4b72-830c-bee405072778 tempest-VolumesActionsTest-1515172499 tempest-VolumesActionsTest-1515172499-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:33:25.856048 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-845835aa-cbd9-45c9-b171-2f822e67aefe tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c286a3f03048689e5ec552bb89c161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09584de3a4b14c5a90eb9b1c2149d6fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:33:25.872446 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-845835aa-cbd9-45c9-b171-2f822e67aefe tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] 10.222.0.18 "GET /compute/v2.1/servers/4eb74274-8b99-455f-8f03-681fbea6b6e0" status: 200 len: 1522 microversion: 2.1 time: 0.625220 Jun 24 16:33:25.873947 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 79/178] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:33:25 2022] GET /compute/v2.1/servers/4eb74274-8b99-455f-8f03-681fbea6b6e0 => generated 1522 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 16:33:25.995919 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-afbf2fc7-6da5-4b72-830c-bee405072778 tempest-VolumesActionsTest-1515172499 tempest-VolumesActionsTest-1515172499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dd95251dce947f8bb6a2739a6557dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fd35a8f65244b5a18f841af49d5c7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:33:26.014347 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-afbf2fc7-6da5-4b72-830c-bee405072778 tempest-VolumesActionsTest-1515172499 tempest-VolumesActionsTest-1515172499-project] 10.222.0.18 "GET /compute/v2.1/servers/2941738f-8dec-4faa-99e4-aca0a28b71e6" status: 200 len: 1314 microversion: 2.1 time: 0.698896 Jun 24 16:33:26.028439 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 100/179] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:33:25 2022] GET /compute/v2.1/servers/2941738f-8dec-4faa-99e4-aca0a28b71e6 => generated 1314 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 16:33:26.898218 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-5b97b828-d483-40c5-9894-c303687f5149 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Calling method '>' {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:33:26.899276 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-5b97b828-d483-40c5-9894-c303687f5149 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] [instance: 4eb74274-8b99-455f-8f03-681fbea6b6e0] Fetching instance by UUID {{(pid=102149) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:33:26.913020 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-5b97b828-d483-40c5-9894-c303687f5149 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:33:26.914136 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-5b97b828-d483-40c5-9894-c303687f5149 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:33:26.916123 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-5b97b828-d483-40c5-9894-c303687f5149 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:33:26.917127 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-5b97b828-d483-40c5-9894-c303687f5149 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:33:27.045433 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-21a1f564-9329-4b6e-9924-7838160876aa tempest-VolumesActionsTest-1515172499 tempest-VolumesActionsTest-1515172499-project] Calling method '>' {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:33:27.047349 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-21a1f564-9329-4b6e-9924-7838160876aa tempest-VolumesActionsTest-1515172499 tempest-VolumesActionsTest-1515172499-project] [instance: 2941738f-8dec-4faa-99e4-aca0a28b71e6] Fetching instance by UUID {{(pid=102148) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:33:27.078605 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-21a1f564-9329-4b6e-9924-7838160876aa tempest-VolumesActionsTest-1515172499 tempest-VolumesActionsTest-1515172499-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:33:27.079440 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-21a1f564-9329-4b6e-9924-7838160876aa tempest-VolumesActionsTest-1515172499 tempest-VolumesActionsTest-1515172499-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:33:27.080832 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-21a1f564-9329-4b6e-9924-7838160876aa tempest-VolumesActionsTest-1515172499 tempest-VolumesActionsTest-1515172499-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:33:27.082123 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-21a1f564-9329-4b6e-9924-7838160876aa tempest-VolumesActionsTest-1515172499 tempest-VolumesActionsTest-1515172499-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:33:27.467741 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-5b97b828-d483-40c5-9894-c303687f5149 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c286a3f03048689e5ec552bb89c161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09584de3a4b14c5a90eb9b1c2149d6fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:33:27.482966 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-5b97b828-d483-40c5-9894-c303687f5149 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] 10.222.0.18 "GET /compute/v2.1/servers/4eb74274-8b99-455f-8f03-681fbea6b6e0" status: 200 len: 1522 microversion: 2.1 time: 0.590333 Jun 24 16:33:27.483886 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 80/180] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:33:26 2022] GET /compute/v2.1/servers/4eb74274-8b99-455f-8f03-681fbea6b6e0 => generated 1522 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 16:33:27.617318 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-21a1f564-9329-4b6e-9924-7838160876aa tempest-VolumesActionsTest-1515172499 tempest-VolumesActionsTest-1515172499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dd95251dce947f8bb6a2739a6557dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fd35a8f65244b5a18f841af49d5c7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:33:27.635028 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-21a1f564-9329-4b6e-9924-7838160876aa tempest-VolumesActionsTest-1515172499 tempest-VolumesActionsTest-1515172499-project] 10.222.0.18 "GET /compute/v2.1/servers/2941738f-8dec-4faa-99e4-aca0a28b71e6" status: 200 len: 1314 microversion: 2.1 time: 0.595265 Jun 24 16:33:27.637174 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 101/181] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:33:27 2022] GET /compute/v2.1/servers/2941738f-8dec-4faa-99e4-aca0a28b71e6 => generated 1314 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 16:33:28.511848 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-5f137427-45d4-4bf6-a9cd-ddc03127570e tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Calling method '>' {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:33:28.512845 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-5f137427-45d4-4bf6-a9cd-ddc03127570e tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] [instance: 4eb74274-8b99-455f-8f03-681fbea6b6e0] Fetching instance by UUID {{(pid=102149) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:33:28.527608 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-5f137427-45d4-4bf6-a9cd-ddc03127570e tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:33:28.542963 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-5f137427-45d4-4bf6-a9cd-ddc03127570e tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:33:28.546347 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-5f137427-45d4-4bf6-a9cd-ddc03127570e tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:33:28.549932 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-5f137427-45d4-4bf6-a9cd-ddc03127570e tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:33:28.657403 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-b4765320-decd-4f0c-a481-ea7be7fb7de1 tempest-VolumesActionsTest-1515172499 tempest-VolumesActionsTest-1515172499-project] Calling method '>' {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:33:28.658757 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-b4765320-decd-4f0c-a481-ea7be7fb7de1 tempest-VolumesActionsTest-1515172499 tempest-VolumesActionsTest-1515172499-project] [instance: 2941738f-8dec-4faa-99e4-aca0a28b71e6] Fetching instance by UUID {{(pid=102148) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:33:28.675221 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-b4765320-decd-4f0c-a481-ea7be7fb7de1 tempest-VolumesActionsTest-1515172499 tempest-VolumesActionsTest-1515172499-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:33:28.676894 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-b4765320-decd-4f0c-a481-ea7be7fb7de1 tempest-VolumesActionsTest-1515172499 tempest-VolumesActionsTest-1515172499-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:33:28.678542 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-b4765320-decd-4f0c-a481-ea7be7fb7de1 tempest-VolumesActionsTest-1515172499 tempest-VolumesActionsTest-1515172499-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:33:28.679201 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-b4765320-decd-4f0c-a481-ea7be7fb7de1 tempest-VolumesActionsTest-1515172499 tempest-VolumesActionsTest-1515172499-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:33:29.131905 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-5f137427-45d4-4bf6-a9cd-ddc03127570e tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c286a3f03048689e5ec552bb89c161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09584de3a4b14c5a90eb9b1c2149d6fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:33:29.145053 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-5f137427-45d4-4bf6-a9cd-ddc03127570e tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] 10.222.0.18 "GET /compute/v2.1/servers/4eb74274-8b99-455f-8f03-681fbea6b6e0" status: 200 len: 1502 microversion: 2.1 time: 0.638788 Jun 24 16:33:29.158933 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 81/182] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:33:28 2022] GET /compute/v2.1/servers/4eb74274-8b99-455f-8f03-681fbea6b6e0 => generated 1502 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 16:33:29.161236 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-b4765320-decd-4f0c-a481-ea7be7fb7de1 tempest-VolumesActionsTest-1515172499 tempest-VolumesActionsTest-1515172499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dd95251dce947f8bb6a2739a6557dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fd35a8f65244b5a18f841af49d5c7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:33:29.168242 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-96e02184-3e12-4672-bec1-d8f8fe5f4572 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "eddf7eed-0d6f-427d-b87b-f8b8e07bd5fb"}} {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 16:33:29.170379 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-96e02184-3e12-4672-bec1-d8f8fe5f4572 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] [instance: 4eb74274-8b99-455f-8f03-681fbea6b6e0] Fetching instance by UUID {{(pid=102149) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:33:29.175909 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-b4765320-decd-4f0c-a481-ea7be7fb7de1 tempest-VolumesActionsTest-1515172499 tempest-VolumesActionsTest-1515172499-project] 10.222.0.18 "GET /compute/v2.1/servers/2941738f-8dec-4faa-99e4-aca0a28b71e6" status: 200 len: 1314 microversion: 2.1 time: 0.523947 Jun 24 16:33:29.177950 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 102/183] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:33:28 2022] GET /compute/v2.1/servers/2941738f-8dec-4faa-99e4-aca0a28b71e6 => generated 1314 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 16:33:29.183018 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-96e02184-3e12-4672-bec1-d8f8fe5f4572 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:33:29.183824 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-96e02184-3e12-4672-bec1-d8f8fe5f4572 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:33:29.184764 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-96e02184-3e12-4672-bec1-d8f8fe5f4572 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:33:29.185198 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-96e02184-3e12-4672-bec1-d8f8fe5f4572 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:33:29.269577 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.wsgi [None req-96e02184-3e12-4672-bec1-d8f8fe5f4572 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] HTTP exception thrown: Cannot 'attach_volume' instance 4eb74274-8b99-455f-8f03-681fbea6b6e0 while it is in vm_state rescued Jun 24 16:33:29.270870 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-96e02184-3e12-4672-bec1-d8f8fe5f4572 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Returning 409 to user: Cannot 'attach_volume' instance 4eb74274-8b99-455f-8f03-681fbea6b6e0 while it is in vm_state rescued {{(pid=102149) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jun 24 16:33:29.272662 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-96e02184-3e12-4672-bec1-d8f8fe5f4572 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] 10.222.0.18 "POST /compute/v2.1/servers/4eb74274-8b99-455f-8f03-681fbea6b6e0/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.111732 Jun 24 16:33:29.277440 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 82/184] 10.222.0.18 () {60 vars in 1322 bytes} [Fri Jun 24 16:33:29 2022] POST /compute/v2.1/servers/4eb74274-8b99-455f-8f03-681fbea6b6e0/os-volume_attachments => generated 152 bytes in 114 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jun 24 16:33:29.287466 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-3bf2de2b-2632-4544-8a87-b84a16c1140e tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 16:33:29.288883 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-3bf2de2b-2632-4544-8a87-b84a16c1140e tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] [instance: 4eb74274-8b99-455f-8f03-681fbea6b6e0] Fetching instance by UUID {{(pid=102148) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:33:29.304435 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-3bf2de2b-2632-4544-8a87-b84a16c1140e tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:33:29.305136 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-3bf2de2b-2632-4544-8a87-b84a16c1140e tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:33:29.306665 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-3bf2de2b-2632-4544-8a87-b84a16c1140e tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:33:29.307363 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-3bf2de2b-2632-4544-8a87-b84a16c1140e tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:33:29.614155 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-3bf2de2b-2632-4544-8a87-b84a16c1140e tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] 10.222.0.18 "POST /compute/v2.1/servers/4eb74274-8b99-455f-8f03-681fbea6b6e0/action" status: 202 len: 0 microversion: 2.1 time: 0.333624 Jun 24 16:33:29.615184 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 103/185] 10.222.0.18 () {60 vars in 1277 bytes} [Fri Jun 24 16:33:29 2022] POST /compute/v2.1/servers/4eb74274-8b99-455f-8f03-681fbea6b6e0/action => generated 0 bytes in 337 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 24 16:33:29.625401 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-31ada2ab-d81d-44e8-a47a-5840d4cfed59 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Calling method '>' {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:33:29.626183 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-31ada2ab-d81d-44e8-a47a-5840d4cfed59 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] [instance: 4eb74274-8b99-455f-8f03-681fbea6b6e0] Fetching instance by UUID {{(pid=102149) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:33:29.634011 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-31ada2ab-d81d-44e8-a47a-5840d4cfed59 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:33:29.634457 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-31ada2ab-d81d-44e8-a47a-5840d4cfed59 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:33:29.635462 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-31ada2ab-d81d-44e8-a47a-5840d4cfed59 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:33:29.636093 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-31ada2ab-d81d-44e8-a47a-5840d4cfed59 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:33:29.936295 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-9f53fee3-d08b-4449-a830-1126e1f44235 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Calling method '>' {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:33:29.938155 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-9f53fee3-d08b-4449-a830-1126e1f44235 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] [instance: 30b3ffec-7110-4b4d-9482-2451914c166f] Fetching instance by UUID {{(pid=102148) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:33:29.951161 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-9f53fee3-d08b-4449-a830-1126e1f44235 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:33:29.951578 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-9f53fee3-d08b-4449-a830-1126e1f44235 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:33:29.952522 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-9f53fee3-d08b-4449-a830-1126e1f44235 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:33:29.953227 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-9f53fee3-d08b-4449-a830-1126e1f44235 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:33:30.148876 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-9f53fee3-d08b-4449-a830-1126e1f44235 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] 10.222.0.18 "GET /compute/v2.1/servers/30b3ffec-7110-4b4d-9482-2451914c166f/ips" status: 200 len: 151 microversion: 2.20 time: 0.217577 Jun 24 16:33:30.149810 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 104/186] 10.222.0.18 () {60 vars in 1288 bytes} [Fri Jun 24 16:33:29 2022] GET /compute/v2.1/servers/30b3ffec-7110-4b4d-9482-2451914c166f/ips => generated 151 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 16:33:30.207413 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-de47a5dd-758d-4615-8a12-5e823ad65f73 tempest-VolumesActionsTest-1515172499 tempest-VolumesActionsTest-1515172499-project] Calling method '>' {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:33:30.208775 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-de47a5dd-758d-4615-8a12-5e823ad65f73 tempest-VolumesActionsTest-1515172499 tempest-VolumesActionsTest-1515172499-project] [instance: 2941738f-8dec-4faa-99e4-aca0a28b71e6] Fetching instance by UUID {{(pid=102148) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:33:30.249030 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-de47a5dd-758d-4615-8a12-5e823ad65f73 tempest-VolumesActionsTest-1515172499 tempest-VolumesActionsTest-1515172499-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:33:30.249610 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-de47a5dd-758d-4615-8a12-5e823ad65f73 tempest-VolumesActionsTest-1515172499 tempest-VolumesActionsTest-1515172499-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:33:30.250512 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-de47a5dd-758d-4615-8a12-5e823ad65f73 tempest-VolumesActionsTest-1515172499 tempest-VolumesActionsTest-1515172499-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:33:30.250976 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-de47a5dd-758d-4615-8a12-5e823ad65f73 tempest-VolumesActionsTest-1515172499 tempest-VolumesActionsTest-1515172499-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:33:30.379216 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-31ada2ab-d81d-44e8-a47a-5840d4cfed59 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c286a3f03048689e5ec552bb89c161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09584de3a4b14c5a90eb9b1c2149d6fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:33:30.396746 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-31ada2ab-d81d-44e8-a47a-5840d4cfed59 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] 10.222.0.18 "GET /compute/v2.1/servers/4eb74274-8b99-455f-8f03-681fbea6b6e0" status: 200 len: 1510 microversion: 2.1 time: 0.775588 Jun 24 16:33:30.415167 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 83/187] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:33:29 2022] GET /compute/v2.1/servers/4eb74274-8b99-455f-8f03-681fbea6b6e0 => generated 1510 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 16:33:30.733685 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-de47a5dd-758d-4615-8a12-5e823ad65f73 tempest-VolumesActionsTest-1515172499 tempest-VolumesActionsTest-1515172499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dd95251dce947f8bb6a2739a6557dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fd35a8f65244b5a18f841af49d5c7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:33:30.748258 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-de47a5dd-758d-4615-8a12-5e823ad65f73 tempest-VolumesActionsTest-1515172499 tempest-VolumesActionsTest-1515172499-project] 10.222.0.18 "GET /compute/v2.1/servers/2941738f-8dec-4faa-99e4-aca0a28b71e6" status: 200 len: 1314 microversion: 2.1 time: 0.547589 Jun 24 16:33:30.750119 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 105/188] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:33:30 2022] GET /compute/v2.1/servers/2941738f-8dec-4faa-99e4-aca0a28b71e6 => generated 1314 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 16:33:31.446348 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-22fccb26-2236-47f0-aefd-7bac9504d628 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Calling method '>' {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:33:31.447845 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-22fccb26-2236-47f0-aefd-7bac9504d628 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] [instance: 4eb74274-8b99-455f-8f03-681fbea6b6e0] Fetching instance by UUID {{(pid=102149) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:33:31.471130 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-22fccb26-2236-47f0-aefd-7bac9504d628 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:33:31.471828 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-22fccb26-2236-47f0-aefd-7bac9504d628 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:33:31.473908 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-22fccb26-2236-47f0-aefd-7bac9504d628 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:33:31.475479 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-22fccb26-2236-47f0-aefd-7bac9504d628 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:33:31.775472 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-d415e6ef-4fc0-4b72-8481-4f157613060f tempest-VolumesActionsTest-1515172499 tempest-VolumesActionsTest-1515172499-project] Calling method '>' {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:33:31.776330 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-d415e6ef-4fc0-4b72-8481-4f157613060f tempest-VolumesActionsTest-1515172499 tempest-VolumesActionsTest-1515172499-project] [instance: 2941738f-8dec-4faa-99e4-aca0a28b71e6] Fetching instance by UUID {{(pid=102148) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:33:31.807487 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-d415e6ef-4fc0-4b72-8481-4f157613060f tempest-VolumesActionsTest-1515172499 tempest-VolumesActionsTest-1515172499-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:33:31.807487 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-d415e6ef-4fc0-4b72-8481-4f157613060f tempest-VolumesActionsTest-1515172499 tempest-VolumesActionsTest-1515172499-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:33:31.809835 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-d415e6ef-4fc0-4b72-8481-4f157613060f tempest-VolumesActionsTest-1515172499 tempest-VolumesActionsTest-1515172499-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:33:31.811941 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-d415e6ef-4fc0-4b72-8481-4f157613060f tempest-VolumesActionsTest-1515172499 tempest-VolumesActionsTest-1515172499-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:33:31.953922 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-22fccb26-2236-47f0-aefd-7bac9504d628 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c286a3f03048689e5ec552bb89c161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09584de3a4b14c5a90eb9b1c2149d6fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:33:31.969062 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-22fccb26-2236-47f0-aefd-7bac9504d628 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] 10.222.0.18 "GET /compute/v2.1/servers/4eb74274-8b99-455f-8f03-681fbea6b6e0" status: 200 len: 1510 microversion: 2.1 time: 0.526543 Jun 24 16:33:31.970800 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 84/189] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:33:31 2022] GET /compute/v2.1/servers/4eb74274-8b99-455f-8f03-681fbea6b6e0 => generated 1510 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 16:33:31.992488 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [req-90790f29-108f-4339-9c3d-6e20cdabdacd req-e4d5fb50-92f8-457e-9ede-5414caf9d707 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2941738f-8dec-4faa-99e4-aca0a28b71e6", "name": "network-vif-plugged", "status": "completed", "tag": "ea66b455-fbf3-476e-94fe-b88e627a3c9c"}]} {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 16:33:31.994288 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 24 16:33:31.994288 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: warnings.warn(msg) Jun 24 16:33:32.019091 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [req-90790f29-108f-4339-9c3d-6e20cdabdacd req-e4d5fb50-92f8-457e-9ede-5414caf9d707 service nova] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:33:32.019633 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [req-90790f29-108f-4339-9c3d-6e20cdabdacd req-e4d5fb50-92f8-457e-9ede-5414caf9d707 service nova] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:33:32.069938 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.compute.server_external_events [req-90790f29-108f-4339-9c3d-6e20cdabdacd req-e4d5fb50-92f8-457e-9ede-5414caf9d707 service nova] Creating event network-vif-plugged:ea66b455-fbf3-476e-94fe-b88e627a3c9c for instance 2941738f-8dec-4faa-99e4-aca0a28b71e6 on hv-cinder-84718 Jun 24 16:33:32.080555 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [req-90790f29-108f-4339-9c3d-6e20cdabdacd req-e4d5fb50-92f8-457e-9ede-5414caf9d707 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101871 Jun 24 16:33:32.083965 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 85/190] 10.222.0.18 () {64 vars in 1317 bytes} [Fri Jun 24 16:33:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 16:33:32.473981 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-d415e6ef-4fc0-4b72-8481-4f157613060f tempest-VolumesActionsTest-1515172499 tempest-VolumesActionsTest-1515172499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dd95251dce947f8bb6a2739a6557dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fd35a8f65244b5a18f841af49d5c7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:33:32.489654 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-d415e6ef-4fc0-4b72-8481-4f157613060f tempest-VolumesActionsTest-1515172499 tempest-VolumesActionsTest-1515172499-project] 10.222.0.18 "GET /compute/v2.1/servers/2941738f-8dec-4faa-99e4-aca0a28b71e6" status: 200 len: 1314 microversion: 2.1 time: 0.718111 Jun 24 16:33:32.490463 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 106/191] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:33:31 2022] GET /compute/v2.1/servers/2941738f-8dec-4faa-99e4-aca0a28b71e6 => generated 1314 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 16:33:32.994142 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-3a0ad5e3-7c8b-4740-93b7-6118bd415589 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Calling method '>' {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:33:32.995599 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-3a0ad5e3-7c8b-4740-93b7-6118bd415589 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] [instance: 4eb74274-8b99-455f-8f03-681fbea6b6e0] Fetching instance by UUID {{(pid=102149) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:33:33.008242 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-3a0ad5e3-7c8b-4740-93b7-6118bd415589 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:33:33.009048 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-3a0ad5e3-7c8b-4740-93b7-6118bd415589 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:33:33.010272 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-3a0ad5e3-7c8b-4740-93b7-6118bd415589 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:33:33.011222 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-3a0ad5e3-7c8b-4740-93b7-6118bd415589 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:33:33.507334 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-76e4729d-e12f-47dc-98fb-2ce551511aa3 tempest-VolumesActionsTest-1515172499 tempest-VolumesActionsTest-1515172499-project] Calling method '>' {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:33:33.507940 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-76e4729d-e12f-47dc-98fb-2ce551511aa3 tempest-VolumesActionsTest-1515172499 tempest-VolumesActionsTest-1515172499-project] [instance: 2941738f-8dec-4faa-99e4-aca0a28b71e6] Fetching instance by UUID {{(pid=102148) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:33:33.531007 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-76e4729d-e12f-47dc-98fb-2ce551511aa3 tempest-VolumesActionsTest-1515172499 tempest-VolumesActionsTest-1515172499-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:33:33.532197 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-76e4729d-e12f-47dc-98fb-2ce551511aa3 tempest-VolumesActionsTest-1515172499 tempest-VolumesActionsTest-1515172499-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:33:33.533200 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-76e4729d-e12f-47dc-98fb-2ce551511aa3 tempest-VolumesActionsTest-1515172499 tempest-VolumesActionsTest-1515172499-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:33:33.533642 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-76e4729d-e12f-47dc-98fb-2ce551511aa3 tempest-VolumesActionsTest-1515172499 tempest-VolumesActionsTest-1515172499-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:33:33.652820 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-3a0ad5e3-7c8b-4740-93b7-6118bd415589 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c286a3f03048689e5ec552bb89c161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09584de3a4b14c5a90eb9b1c2149d6fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:33:33.665509 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-3a0ad5e3-7c8b-4740-93b7-6118bd415589 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] 10.222.0.18 "GET /compute/v2.1/servers/4eb74274-8b99-455f-8f03-681fbea6b6e0" status: 200 len: 1510 microversion: 2.1 time: 0.676737 Jun 24 16:33:33.695704 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 86/192] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:33:32 2022] GET /compute/v2.1/servers/4eb74274-8b99-455f-8f03-681fbea6b6e0 => generated 1510 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 16:33:33.883196 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-76e4729d-e12f-47dc-98fb-2ce551511aa3 tempest-VolumesActionsTest-1515172499 tempest-VolumesActionsTest-1515172499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dd95251dce947f8bb6a2739a6557dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fd35a8f65244b5a18f841af49d5c7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:33:33.892090 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-76e4729d-e12f-47dc-98fb-2ce551511aa3 tempest-VolumesActionsTest-1515172499 tempest-VolumesActionsTest-1515172499-project] 10.222.0.18 "GET /compute/v2.1/servers/2941738f-8dec-4faa-99e4-aca0a28b71e6" status: 200 len: 1314 microversion: 2.1 time: 0.388816 Jun 24 16:33:33.892681 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 107/193] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:33:33 2022] GET /compute/v2.1/servers/2941738f-8dec-4faa-99e4-aca0a28b71e6 => generated 1314 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 16:33:34.306489 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-3ab41372-d8e8-42a1-be3a-3fbe31b66cfd tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 16:33:34.307282 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-3ab41372-d8e8-42a1-be3a-3fbe31b66cfd tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] [instance: 30b3ffec-7110-4b4d-9482-2451914c166f] Fetching instance by UUID {{(pid=102149) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:33:34.336414 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-3ab41372-d8e8-42a1-be3a-3fbe31b66cfd tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:33:34.336991 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-3ab41372-d8e8-42a1-be3a-3fbe31b66cfd tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:33:34.337880 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-3ab41372-d8e8-42a1-be3a-3fbe31b66cfd tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:33:34.338317 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-3ab41372-d8e8-42a1-be3a-3fbe31b66cfd tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:33:34.560074 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.objects.instance [None req-3ab41372-d8e8-42a1-be3a-3fbe31b66cfd tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lazy-loading 'flavor' on Instance uuid 30b3ffec-7110-4b4d-9482-2451914c166f {{(pid=102149) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Jun 24 16:33:34.717377 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-bf9a52b9-8378-42e8-819c-d47008ec250a tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Calling method '>' {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:33:34.718242 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-bf9a52b9-8378-42e8-819c-d47008ec250a tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] [instance: 4eb74274-8b99-455f-8f03-681fbea6b6e0] Fetching instance by UUID {{(pid=102148) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:33:34.738835 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-bf9a52b9-8378-42e8-819c-d47008ec250a tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:33:34.739711 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-bf9a52b9-8378-42e8-819c-d47008ec250a tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:33:34.740715 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-bf9a52b9-8378-42e8-819c-d47008ec250a tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:33:34.741162 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-bf9a52b9-8378-42e8-819c-d47008ec250a tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:33:35.257974 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-3ab41372-d8e8-42a1-be3a-3fbe31b66cfd tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] 10.222.0.18 "POST /compute/v2.1/servers/30b3ffec-7110-4b4d-9482-2451914c166f/action" status: 202 len: 0 microversion: 2.20 time: 0.955105 Jun 24 16:33:35.264524 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 87/194] 10.222.0.18 () {62 vars in 1318 bytes} [Fri Jun 24 16:33:34 2022] POST /compute/v2.1/servers/30b3ffec-7110-4b4d-9482-2451914c166f/action => generated 0 bytes in 958 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jun 24 16:33:35.298001 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-a901085f-1f33-42b9-9836-dba5fabe33b5 tempest-VolumesActionsTest-1515172499 tempest-VolumesActionsTest-1515172499-project] Calling method '>' {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:33:35.299195 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-a901085f-1f33-42b9-9836-dba5fabe33b5 tempest-VolumesActionsTest-1515172499 tempest-VolumesActionsTest-1515172499-project] [instance: 2941738f-8dec-4faa-99e4-aca0a28b71e6] Fetching instance by UUID {{(pid=102149) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:33:35.308194 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-a901085f-1f33-42b9-9836-dba5fabe33b5 tempest-VolumesActionsTest-1515172499 tempest-VolumesActionsTest-1515172499-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:33:35.309208 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-a901085f-1f33-42b9-9836-dba5fabe33b5 tempest-VolumesActionsTest-1515172499 tempest-VolumesActionsTest-1515172499-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:33:35.323818 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-a901085f-1f33-42b9-9836-dba5fabe33b5 tempest-VolumesActionsTest-1515172499 tempest-VolumesActionsTest-1515172499-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:33:35.324818 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-a901085f-1f33-42b9-9836-dba5fabe33b5 tempest-VolumesActionsTest-1515172499 tempest-VolumesActionsTest-1515172499-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:33:35.395705 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-bf9a52b9-8378-42e8-819c-d47008ec250a tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c286a3f03048689e5ec552bb89c161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09584de3a4b14c5a90eb9b1c2149d6fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:33:35.430281 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-bf9a52b9-8378-42e8-819c-d47008ec250a tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] 10.222.0.18 "GET /compute/v2.1/servers/4eb74274-8b99-455f-8f03-681fbea6b6e0" status: 200 len: 1516 microversion: 2.1 time: 0.715326 Jun 24 16:33:35.434843 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 108/195] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:33:34 2022] GET /compute/v2.1/servers/4eb74274-8b99-455f-8f03-681fbea6b6e0 => generated 1516 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 16:33:35.454246 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-cb94a60f-3fb3-4afe-9aa1-81c82ebf70de tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Calling method '>' {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:33:35.467965 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-cb94a60f-3fb3-4afe-9aa1-81c82ebf70de tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] [instance: 30b3ffec-7110-4b4d-9482-2451914c166f] Fetching instance by UUID {{(pid=102148) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:33:35.500660 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-cb94a60f-3fb3-4afe-9aa1-81c82ebf70de tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:33:35.504331 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-cb94a60f-3fb3-4afe-9aa1-81c82ebf70de tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:33:35.505582 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-cb94a60f-3fb3-4afe-9aa1-81c82ebf70de tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:33:35.508341 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-cb94a60f-3fb3-4afe-9aa1-81c82ebf70de tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:33:36.268065 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-a901085f-1f33-42b9-9836-dba5fabe33b5 tempest-VolumesActionsTest-1515172499 tempest-VolumesActionsTest-1515172499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dd95251dce947f8bb6a2739a6557dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fd35a8f65244b5a18f841af49d5c7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:33:36.280894 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-a901085f-1f33-42b9-9836-dba5fabe33b5 tempest-VolumesActionsTest-1515172499 tempest-VolumesActionsTest-1515172499-project] 10.222.0.18 "GET /compute/v2.1/servers/2941738f-8dec-4faa-99e4-aca0a28b71e6" status: 200 len: 1497 microversion: 2.1 time: 1.000919 Jun 24 16:33:36.281669 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 88/196] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:33:35 2022] GET /compute/v2.1/servers/2941738f-8dec-4faa-99e4-aca0a28b71e6 => generated 1497 bytes in 1016 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 16:33:36.285087 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-cb94a60f-3fb3-4afe-9aa1-81c82ebf70de tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7489b29cb3ef47d78dfd55794f338b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065254ebe67545639644fcbc6bd9fc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:33:36.298950 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-cb94a60f-3fb3-4afe-9aa1-81c82ebf70de tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7489b29cb3ef47d78dfd55794f338b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065254ebe67545639644fcbc6bd9fc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:33:36.304856 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-cb94a60f-3fb3-4afe-9aa1-81c82ebf70de tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7489b29cb3ef47d78dfd55794f338b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065254ebe67545639644fcbc6bd9fc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:33:36.306483 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-cb94a60f-3fb3-4afe-9aa1-81c82ebf70de tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] 10.222.0.18 "GET /compute/v2.1/servers/30b3ffec-7110-4b4d-9482-2451914c166f" status: 200 len: 1722 microversion: 2.20 time: 0.867518 Jun 24 16:33:36.307258 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 109/197] 10.222.0.18 () {60 vars in 1276 bytes} [Fri Jun 24 16:33:35 2022] GET /compute/v2.1/servers/30b3ffec-7110-4b4d-9482-2451914c166f => generated 1722 bytes in 872 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 16:33:37.325503 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-5659408a-60ac-457f-b89e-1096e1251f6c tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Calling method '>' {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:33:37.326246 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-5659408a-60ac-457f-b89e-1096e1251f6c tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] [instance: 30b3ffec-7110-4b4d-9482-2451914c166f] Fetching instance by UUID {{(pid=102149) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:33:37.335929 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-5659408a-60ac-457f-b89e-1096e1251f6c tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:33:37.336608 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-5659408a-60ac-457f-b89e-1096e1251f6c tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:33:37.338113 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-5659408a-60ac-457f-b89e-1096e1251f6c tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:33:37.338632 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-5659408a-60ac-457f-b89e-1096e1251f6c tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:33:37.972615 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-5659408a-60ac-457f-b89e-1096e1251f6c tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7489b29cb3ef47d78dfd55794f338b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065254ebe67545639644fcbc6bd9fc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:33:37.984687 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-5659408a-60ac-457f-b89e-1096e1251f6c tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7489b29cb3ef47d78dfd55794f338b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065254ebe67545639644fcbc6bd9fc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:33:37.988318 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-5659408a-60ac-457f-b89e-1096e1251f6c tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7489b29cb3ef47d78dfd55794f338b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065254ebe67545639644fcbc6bd9fc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:33:37.998797 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-5659408a-60ac-457f-b89e-1096e1251f6c tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] 10.222.0.18 "GET /compute/v2.1/servers/30b3ffec-7110-4b4d-9482-2451914c166f" status: 200 len: 1722 microversion: 2.20 time: 0.676622 Jun 24 16:33:38.005271 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 89/198] 10.222.0.18 () {60 vars in 1276 bytes} [Fri Jun 24 16:33:37 2022] GET /compute/v2.1/servers/30b3ffec-7110-4b4d-9482-2451914c166f => generated 1722 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 16:33:39.027601 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-8a716b95-879d-4979-9466-f64ed3e5b6e8 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Calling method '>' {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:33:39.028457 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-8a716b95-879d-4979-9466-f64ed3e5b6e8 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] [instance: 30b3ffec-7110-4b4d-9482-2451914c166f] Fetching instance by UUID {{(pid=102148) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:33:39.037631 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-8a716b95-879d-4979-9466-f64ed3e5b6e8 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:33:39.038071 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-8a716b95-879d-4979-9466-f64ed3e5b6e8 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:33:39.039149 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-8a716b95-879d-4979-9466-f64ed3e5b6e8 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:33:39.039578 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-8a716b95-879d-4979-9466-f64ed3e5b6e8 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:33:39.118761 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-e9908bf2-51e8-4c7c-be6c-d04d857c6ac7 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Calling method '>' {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:33:39.121436 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-e9908bf2-51e8-4c7c-be6c-d04d857c6ac7 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] [instance: 2fa4f019-3cbd-4b41-a0fc-6513f46474c0] Fetching instance by UUID {{(pid=102149) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:33:39.139719 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-e9908bf2-51e8-4c7c-be6c-d04d857c6ac7 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:33:39.141412 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-e9908bf2-51e8-4c7c-be6c-d04d857c6ac7 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:33:39.143194 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-e9908bf2-51e8-4c7c-be6c-d04d857c6ac7 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:33:39.144217 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-e9908bf2-51e8-4c7c-be6c-d04d857c6ac7 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:33:39.270306 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-e9908bf2-51e8-4c7c-be6c-d04d857c6ac7 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] 10.222.0.18 "GET /compute/v2.1/servers/2fa4f019-3cbd-4b41-a0fc-6513f46474c0/ips" status: 200 len: 150 microversion: 2.1 time: 0.159494 Jun 24 16:33:39.271335 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 90/199] 10.222.0.18 () {58 vars in 1247 bytes} [Fri Jun 24 16:33:39 2022] GET /compute/v2.1/servers/2fa4f019-3cbd-4b41-a0fc-6513f46474c0/ips => generated 150 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 16:33:39.601092 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-8a716b95-879d-4979-9466-f64ed3e5b6e8 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7489b29cb3ef47d78dfd55794f338b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065254ebe67545639644fcbc6bd9fc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:33:39.612167 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-8a716b95-879d-4979-9466-f64ed3e5b6e8 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7489b29cb3ef47d78dfd55794f338b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065254ebe67545639644fcbc6bd9fc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:33:39.615172 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-8a716b95-879d-4979-9466-f64ed3e5b6e8 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7489b29cb3ef47d78dfd55794f338b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065254ebe67545639644fcbc6bd9fc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:33:39.616862 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-8a716b95-879d-4979-9466-f64ed3e5b6e8 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] 10.222.0.18 "GET /compute/v2.1/servers/30b3ffec-7110-4b4d-9482-2451914c166f" status: 200 len: 1722 microversion: 2.20 time: 0.593765 Jun 24 16:33:39.618929 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 110/200] 10.222.0.18 () {60 vars in 1276 bytes} [Fri Jun 24 16:33:39 2022] GET /compute/v2.1/servers/30b3ffec-7110-4b4d-9482-2451914c166f => generated 1722 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 16:33:40.642956 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-72d4f4d4-ecdd-4f9b-8bac-7e5ae7244b42 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Calling method '>' {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:33:40.643747 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-72d4f4d4-ecdd-4f9b-8bac-7e5ae7244b42 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] [instance: 30b3ffec-7110-4b4d-9482-2451914c166f] Fetching instance by UUID {{(pid=102149) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:33:40.651930 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-72d4f4d4-ecdd-4f9b-8bac-7e5ae7244b42 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:33:40.652377 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-72d4f4d4-ecdd-4f9b-8bac-7e5ae7244b42 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:33:40.653271 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-72d4f4d4-ecdd-4f9b-8bac-7e5ae7244b42 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:33:40.653696 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-72d4f4d4-ecdd-4f9b-8bac-7e5ae7244b42 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:33:40.937155 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-72d4f4d4-ecdd-4f9b-8bac-7e5ae7244b42 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7489b29cb3ef47d78dfd55794f338b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065254ebe67545639644fcbc6bd9fc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:33:40.955566 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-72d4f4d4-ecdd-4f9b-8bac-7e5ae7244b42 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7489b29cb3ef47d78dfd55794f338b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065254ebe67545639644fcbc6bd9fc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:33:40.957388 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-72d4f4d4-ecdd-4f9b-8bac-7e5ae7244b42 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7489b29cb3ef47d78dfd55794f338b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065254ebe67545639644fcbc6bd9fc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:33:40.959423 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-72d4f4d4-ecdd-4f9b-8bac-7e5ae7244b42 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] 10.222.0.18 "GET /compute/v2.1/servers/30b3ffec-7110-4b4d-9482-2451914c166f" status: 200 len: 1722 microversion: 2.20 time: 0.322579 Jun 24 16:33:40.960363 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 91/201] 10.222.0.18 () {60 vars in 1276 bytes} [Fri Jun 24 16:33:40 2022] GET /compute/v2.1/servers/30b3ffec-7110-4b4d-9482-2451914c166f => generated 1722 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 16:33:41.592066 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-8d4cd94c-688e-4db6-b2dd-f33c87639625 tempest-VolumesActionsTest-1515172499 tempest-VolumesActionsTest-1515172499-project] Calling method '>' {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:33:41.595018 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-8d4cd94c-688e-4db6-b2dd-f33c87639625 tempest-VolumesActionsTest-1515172499 tempest-VolumesActionsTest-1515172499-project] [instance: 2941738f-8dec-4faa-99e4-aca0a28b71e6] Fetching instance by UUID {{(pid=102148) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:33:41.620097 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-8d4cd94c-688e-4db6-b2dd-f33c87639625 tempest-VolumesActionsTest-1515172499 tempest-VolumesActionsTest-1515172499-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:33:41.620655 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-8d4cd94c-688e-4db6-b2dd-f33c87639625 tempest-VolumesActionsTest-1515172499 tempest-VolumesActionsTest-1515172499-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:33:41.625504 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-8d4cd94c-688e-4db6-b2dd-f33c87639625 tempest-VolumesActionsTest-1515172499 tempest-VolumesActionsTest-1515172499-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:33:41.627162 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-8d4cd94c-688e-4db6-b2dd-f33c87639625 tempest-VolumesActionsTest-1515172499 tempest-VolumesActionsTest-1515172499-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:33:41.718482 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-8d4cd94c-688e-4db6-b2dd-f33c87639625 tempest-VolumesActionsTest-1515172499 tempest-VolumesActionsTest-1515172499-project] [instance: 2941738f-8dec-4faa-99e4-aca0a28b71e6] Going to try to terminate instance {{(pid=102148) delete /opt/stack/nova/nova/compute/api.py:2562}} Jun 24 16:33:41.939335 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-8d4cd94c-688e-4db6-b2dd-f33c87639625 tempest-VolumesActionsTest-1515172499 tempest-VolumesActionsTest-1515172499-project] 10.222.0.18 "DELETE /compute/v2.1/servers/2941738f-8dec-4faa-99e4-aca0a28b71e6" status: 204 len: 0 microversion: 2.1 time: 0.352172 Jun 24 16:33:41.940192 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 111/202] 10.222.0.18 () {58 vars in 1238 bytes} [Fri Jun 24 16:33:41 2022] DELETE /compute/v2.1/servers/2941738f-8dec-4faa-99e4-aca0a28b71e6 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 24 16:33:41.951544 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-bba77048-bf19-47d5-9146-e474c9492ae4 tempest-VolumesActionsTest-1515172499 tempest-VolumesActionsTest-1515172499-project] Calling method '>' {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:33:41.953356 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-bba77048-bf19-47d5-9146-e474c9492ae4 tempest-VolumesActionsTest-1515172499 tempest-VolumesActionsTest-1515172499-project] [instance: 2941738f-8dec-4faa-99e4-aca0a28b71e6] Fetching instance by UUID {{(pid=102149) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:33:41.962929 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-bba77048-bf19-47d5-9146-e474c9492ae4 tempest-VolumesActionsTest-1515172499 tempest-VolumesActionsTest-1515172499-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:33:41.963230 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-bba77048-bf19-47d5-9146-e474c9492ae4 tempest-VolumesActionsTest-1515172499 tempest-VolumesActionsTest-1515172499-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:33:41.964216 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-bba77048-bf19-47d5-9146-e474c9492ae4 tempest-VolumesActionsTest-1515172499 tempest-VolumesActionsTest-1515172499-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:33:41.964865 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-bba77048-bf19-47d5-9146-e474c9492ae4 tempest-VolumesActionsTest-1515172499 tempest-VolumesActionsTest-1515172499-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:33:41.984178 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-153e2b0a-23d4-4b3f-abc3-35846c34bb97 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Calling method '>' {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:33:41.985820 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-153e2b0a-23d4-4b3f-abc3-35846c34bb97 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] [instance: 30b3ffec-7110-4b4d-9482-2451914c166f] Fetching instance by UUID {{(pid=102148) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:33:42.004171 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-153e2b0a-23d4-4b3f-abc3-35846c34bb97 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:33:42.006560 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-153e2b0a-23d4-4b3f-abc3-35846c34bb97 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:33:42.012075 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-153e2b0a-23d4-4b3f-abc3-35846c34bb97 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:33:42.013001 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-153e2b0a-23d4-4b3f-abc3-35846c34bb97 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:33:42.660468 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-bba77048-bf19-47d5-9146-e474c9492ae4 tempest-VolumesActionsTest-1515172499 tempest-VolumesActionsTest-1515172499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dd95251dce947f8bb6a2739a6557dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fd35a8f65244b5a18f841af49d5c7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:33:42.677011 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-bba77048-bf19-47d5-9146-e474c9492ae4 tempest-VolumesActionsTest-1515172499 tempest-VolumesActionsTest-1515172499-project] 10.222.0.18 "GET /compute/v2.1/servers/2941738f-8dec-4faa-99e4-aca0a28b71e6" status: 200 len: 1503 microversion: 2.1 time: 0.731959 Jun 24 16:33:42.687862 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 92/203] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:33:41 2022] GET /compute/v2.1/servers/2941738f-8dec-4faa-99e4-aca0a28b71e6 => generated 1503 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 16:33:42.702240 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-1c15fdc6-816e-4cd2-a981-11507816c9b3 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Action: 'create', calling method: .version_select at 0x7f1ae82f2160>, body: {"keypair": {"name": "tempest-keypair-554596742", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPTmKwuvwgkCzKq0b7Mvan1Zyh7H0e1IHulmKHp23WIx4vSLrWJuPtnbcBHI47Z0lE2j9cMMphT7+tejdijWSzp4tg4afvAYWayk171jrfogQzeurH0S1Ke4DIYabTiuuA=="}} {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 16:33:42.745867 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-153e2b0a-23d4-4b3f-abc3-35846c34bb97 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7489b29cb3ef47d78dfd55794f338b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065254ebe67545639644fcbc6bd9fc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:33:42.786508 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-153e2b0a-23d4-4b3f-abc3-35846c34bb97 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7489b29cb3ef47d78dfd55794f338b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065254ebe67545639644fcbc6bd9fc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:33:42.792197 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-153e2b0a-23d4-4b3f-abc3-35846c34bb97 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7489b29cb3ef47d78dfd55794f338b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065254ebe67545639644fcbc6bd9fc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:33:42.793654 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.quota [None req-1c15fdc6-816e-4cd2-a981-11507816c9b3 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Getting quotas for project 09584de3a4b14c5a90eb9b1c2149d6fb. Resources: {'key_pairs'} {{(pid=102149) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jun 24 16:33:42.795210 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-153e2b0a-23d4-4b3f-abc3-35846c34bb97 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] 10.222.0.18 "GET /compute/v2.1/servers/30b3ffec-7110-4b4d-9482-2451914c166f" status: 200 len: 1722 microversion: 2.20 time: 0.819737 Jun 24 16:33:42.812932 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 112/204] 10.222.0.18 () {60 vars in 1276 bytes} [Fri Jun 24 16:33:41 2022] GET /compute/v2.1/servers/30b3ffec-7110-4b4d-9482-2451914c166f => generated 1722 bytes in 838 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 16:33:42.832308 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-e151c201-fdcc-4408-875b-a22a1bb3fc04 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "467872fc-992c-4e59-b37a-ac7871d81099"}} {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 16:33:42.835720 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.quota [None req-1c15fdc6-816e-4cd2-a981-11507816c9b3 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Getting quotas for user f2c286a3f03048689e5ec552bb89c161 and project 09584de3a4b14c5a90eb9b1c2149d6fb. Resources: {'key_pairs'} {{(pid=102149) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jun 24 16:33:42.842294 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-e151c201-fdcc-4408-875b-a22a1bb3fc04 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] [instance: 2fa4f019-3cbd-4b41-a0fc-6513f46474c0] Fetching instance by UUID {{(pid=102148) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:33:42.863166 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-e151c201-fdcc-4408-875b-a22a1bb3fc04 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:33:42.863845 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-e151c201-fdcc-4408-875b-a22a1bb3fc04 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:33:42.866133 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-e151c201-fdcc-4408-875b-a22a1bb3fc04 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:33:42.871175 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-e151c201-fdcc-4408-875b-a22a1bb3fc04 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:33:42.901403 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-1c15fdc6-816e-4cd2-a981-11507816c9b3 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.211581 Jun 24 16:33:42.902664 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 93/205] 10.222.0.18 () {60 vars in 1158 bytes} [Fri Jun 24 16:33:42 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 16:33:43.713774 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-20d7cbdb-b8e3-43d5-bfd0-49d2fc1a68e0 tempest-VolumesActionsTest-1515172499 tempest-VolumesActionsTest-1515172499-project] Calling method '>' {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:33:43.715862 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-20d7cbdb-b8e3-43d5-bfd0-49d2fc1a68e0 tempest-VolumesActionsTest-1515172499 tempest-VolumesActionsTest-1515172499-project] [instance: 2941738f-8dec-4faa-99e4-aca0a28b71e6] Fetching instance by UUID {{(pid=102149) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:33:43.751660 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-20d7cbdb-b8e3-43d5-bfd0-49d2fc1a68e0 tempest-VolumesActionsTest-1515172499 tempest-VolumesActionsTest-1515172499-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:33:43.752982 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-20d7cbdb-b8e3-43d5-bfd0-49d2fc1a68e0 tempest-VolumesActionsTest-1515172499 tempest-VolumesActionsTest-1515172499-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:33:43.755528 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-20d7cbdb-b8e3-43d5-bfd0-49d2fc1a68e0 tempest-VolumesActionsTest-1515172499 tempest-VolumesActionsTest-1515172499-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:33:43.757118 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-20d7cbdb-b8e3-43d5-bfd0-49d2fc1a68e0 tempest-VolumesActionsTest-1515172499 tempest-VolumesActionsTest-1515172499-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:33:43.801181 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-e151c201-fdcc-4408-875b-a22a1bb3fc04 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] 10.222.0.18 "POST /compute/v2.1/servers/2fa4f019-3cbd-4b41-a0fc-6513f46474c0/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.985505 Jun 24 16:33:43.814059 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 113/206] 10.222.0.18 () {60 vars in 1322 bytes} [Fri Jun 24 16:33:42 2022] POST /compute/v2.1/servers/2fa4f019-3cbd-4b41-a0fc-6513f46474c0/os-volume_attachments => generated 194 bytes in 1000 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 16:33:43.838111 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-5ba2ef62-4541-499d-becb-670c862a9d22 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Calling method '>' {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:33:43.852652 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-5ba2ef62-4541-499d-becb-670c862a9d22 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] [instance: 30b3ffec-7110-4b4d-9482-2451914c166f] Fetching instance by UUID {{(pid=102148) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:33:43.872755 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-5ba2ef62-4541-499d-becb-670c862a9d22 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:33:43.887857 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-5ba2ef62-4541-499d-becb-670c862a9d22 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:33:43.889659 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-5ba2ef62-4541-499d-becb-670c862a9d22 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:33:43.891781 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-5ba2ef62-4541-499d-becb-670c862a9d22 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:33:44.495914 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-20d7cbdb-b8e3-43d5-bfd0-49d2fc1a68e0 tempest-VolumesActionsTest-1515172499 tempest-VolumesActionsTest-1515172499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dd95251dce947f8bb6a2739a6557dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fd35a8f65244b5a18f841af49d5c7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:33:44.527951 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-20d7cbdb-b8e3-43d5-bfd0-49d2fc1a68e0 tempest-VolumesActionsTest-1515172499 tempest-VolumesActionsTest-1515172499-project] 10.222.0.18 "GET /compute/v2.1/servers/2941738f-8dec-4faa-99e4-aca0a28b71e6" status: 200 len: 1503 microversion: 2.1 time: 0.828525 Jun 24 16:33:44.540782 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 94/207] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:33:43 2022] GET /compute/v2.1/servers/2941738f-8dec-4faa-99e4-aca0a28b71e6 => generated 1503 bytes in 834 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 16:33:44.699780 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-5ba2ef62-4541-499d-becb-670c862a9d22 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7489b29cb3ef47d78dfd55794f338b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065254ebe67545639644fcbc6bd9fc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:33:44.728589 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-5ba2ef62-4541-499d-becb-670c862a9d22 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7489b29cb3ef47d78dfd55794f338b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065254ebe67545639644fcbc6bd9fc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:33:44.738377 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-5ba2ef62-4541-499d-becb-670c862a9d22 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7489b29cb3ef47d78dfd55794f338b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065254ebe67545639644fcbc6bd9fc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:33:44.742250 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-5ba2ef62-4541-499d-becb-670c862a9d22 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] 10.222.0.18 "GET /compute/v2.1/servers/30b3ffec-7110-4b4d-9482-2451914c166f" status: 200 len: 1722 microversion: 2.20 time: 0.915686 Jun 24 16:33:44.744302 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 114/208] 10.222.0.18 () {60 vars in 1276 bytes} [Fri Jun 24 16:33:43 2022] GET /compute/v2.1/servers/30b3ffec-7110-4b4d-9482-2451914c166f => generated 1722 bytes in 921 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 16:33:45.551921 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-66985c84-29bb-44b7-a8f7-53e72f8d0fbb tempest-VolumesActionsTest-1515172499 tempest-VolumesActionsTest-1515172499-project] Calling method '>' {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:33:45.553180 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-66985c84-29bb-44b7-a8f7-53e72f8d0fbb tempest-VolumesActionsTest-1515172499 tempest-VolumesActionsTest-1515172499-project] [instance: 2941738f-8dec-4faa-99e4-aca0a28b71e6] Fetching instance by UUID {{(pid=102149) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:33:45.574954 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-66985c84-29bb-44b7-a8f7-53e72f8d0fbb tempest-VolumesActionsTest-1515172499 tempest-VolumesActionsTest-1515172499-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:33:45.577945 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-66985c84-29bb-44b7-a8f7-53e72f8d0fbb tempest-VolumesActionsTest-1515172499 tempest-VolumesActionsTest-1515172499-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:33:45.584494 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-66985c84-29bb-44b7-a8f7-53e72f8d0fbb tempest-VolumesActionsTest-1515172499 tempest-VolumesActionsTest-1515172499-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:33:45.585438 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-66985c84-29bb-44b7-a8f7-53e72f8d0fbb tempest-VolumesActionsTest-1515172499 tempest-VolumesActionsTest-1515172499-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:33:45.769799 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-6a1c6ea9-e7cf-4cf2-973a-ca4e0eaa2503 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Calling method '>' {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:33:45.771763 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-6a1c6ea9-e7cf-4cf2-973a-ca4e0eaa2503 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] [instance: 30b3ffec-7110-4b4d-9482-2451914c166f] Fetching instance by UUID {{(pid=102148) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:33:45.801147 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-6a1c6ea9-e7cf-4cf2-973a-ca4e0eaa2503 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:33:45.802772 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-6a1c6ea9-e7cf-4cf2-973a-ca4e0eaa2503 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:33:45.804454 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-6a1c6ea9-e7cf-4cf2-973a-ca4e0eaa2503 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:33:45.805588 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-6a1c6ea9-e7cf-4cf2-973a-ca4e0eaa2503 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:33:46.136811 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-66985c84-29bb-44b7-a8f7-53e72f8d0fbb tempest-VolumesActionsTest-1515172499 tempest-VolumesActionsTest-1515172499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dd95251dce947f8bb6a2739a6557dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fd35a8f65244b5a18f841af49d5c7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:33:46.158376 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-66985c84-29bb-44b7-a8f7-53e72f8d0fbb tempest-VolumesActionsTest-1515172499 tempest-VolumesActionsTest-1515172499-project] 10.222.0.18 "GET /compute/v2.1/servers/2941738f-8dec-4faa-99e4-aca0a28b71e6" status: 200 len: 1503 microversion: 2.1 time: 0.612408 Jun 24 16:33:46.172680 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 95/209] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:33:45 2022] GET /compute/v2.1/servers/2941738f-8dec-4faa-99e4-aca0a28b71e6 => generated 1503 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 16:33:46.301902 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-6a1c6ea9-e7cf-4cf2-973a-ca4e0eaa2503 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7489b29cb3ef47d78dfd55794f338b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065254ebe67545639644fcbc6bd9fc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:33:46.324083 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-6a1c6ea9-e7cf-4cf2-973a-ca4e0eaa2503 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7489b29cb3ef47d78dfd55794f338b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065254ebe67545639644fcbc6bd9fc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:33:46.328357 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-6a1c6ea9-e7cf-4cf2-973a-ca4e0eaa2503 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7489b29cb3ef47d78dfd55794f338b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065254ebe67545639644fcbc6bd9fc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:33:46.330815 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-6a1c6ea9-e7cf-4cf2-973a-ca4e0eaa2503 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] 10.222.0.18 "GET /compute/v2.1/servers/30b3ffec-7110-4b4d-9482-2451914c166f" status: 200 len: 1722 microversion: 2.20 time: 0.565262 Jun 24 16:33:46.339812 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 115/210] 10.222.0.18 () {60 vars in 1276 bytes} [Fri Jun 24 16:33:45 2022] GET /compute/v2.1/servers/30b3ffec-7110-4b4d-9482-2451914c166f => generated 1722 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 16:33:47.199796 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-ce91716f-fef3-4dfd-9c92-77279531b685 tempest-VolumesActionsTest-1515172499 tempest-VolumesActionsTest-1515172499-project] Calling method '>' {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:33:47.201049 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-ce91716f-fef3-4dfd-9c92-77279531b685 tempest-VolumesActionsTest-1515172499 tempest-VolumesActionsTest-1515172499-project] [instance: 2941738f-8dec-4faa-99e4-aca0a28b71e6] Fetching instance by UUID {{(pid=102149) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:33:47.210706 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-ce91716f-fef3-4dfd-9c92-77279531b685 tempest-VolumesActionsTest-1515172499 tempest-VolumesActionsTest-1515172499-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:33:47.213760 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-ce91716f-fef3-4dfd-9c92-77279531b685 tempest-VolumesActionsTest-1515172499 tempest-VolumesActionsTest-1515172499-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:33:47.214819 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-ce91716f-fef3-4dfd-9c92-77279531b685 tempest-VolumesActionsTest-1515172499 tempest-VolumesActionsTest-1515172499-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:33:47.222377 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-ce91716f-fef3-4dfd-9c92-77279531b685 tempest-VolumesActionsTest-1515172499 tempest-VolumesActionsTest-1515172499-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:33:47.371604 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-d7a672f0-b3e0-4312-a1e6-9f7ff7536850 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Calling method '>' {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:33:47.372521 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-d7a672f0-b3e0-4312-a1e6-9f7ff7536850 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] [instance: 30b3ffec-7110-4b4d-9482-2451914c166f] Fetching instance by UUID {{(pid=102148) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:33:47.427351 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-d7a672f0-b3e0-4312-a1e6-9f7ff7536850 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:33:47.428157 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-d7a672f0-b3e0-4312-a1e6-9f7ff7536850 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:33:47.429438 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-d7a672f0-b3e0-4312-a1e6-9f7ff7536850 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:33:47.430160 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-d7a672f0-b3e0-4312-a1e6-9f7ff7536850 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:33:47.968520 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-ce91716f-fef3-4dfd-9c92-77279531b685 tempest-VolumesActionsTest-1515172499 tempest-VolumesActionsTest-1515172499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dd95251dce947f8bb6a2739a6557dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fd35a8f65244b5a18f841af49d5c7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:33:47.981148 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-ce91716f-fef3-4dfd-9c92-77279531b685 tempest-VolumesActionsTest-1515172499 tempest-VolumesActionsTest-1515172499-project] 10.222.0.18 "GET /compute/v2.1/servers/2941738f-8dec-4faa-99e4-aca0a28b71e6" status: 200 len: 1503 microversion: 2.1 time: 0.782469 Jun 24 16:33:47.990387 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 96/211] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:33:47 2022] GET /compute/v2.1/servers/2941738f-8dec-4faa-99e4-aca0a28b71e6 => generated 1503 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 16:33:48.404451 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-d7a672f0-b3e0-4312-a1e6-9f7ff7536850 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7489b29cb3ef47d78dfd55794f338b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065254ebe67545639644fcbc6bd9fc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:33:48.449249 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-d7a672f0-b3e0-4312-a1e6-9f7ff7536850 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7489b29cb3ef47d78dfd55794f338b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065254ebe67545639644fcbc6bd9fc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:33:48.453682 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-d7a672f0-b3e0-4312-a1e6-9f7ff7536850 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7489b29cb3ef47d78dfd55794f338b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065254ebe67545639644fcbc6bd9fc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:33:48.458938 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-d7a672f0-b3e0-4312-a1e6-9f7ff7536850 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] 10.222.0.18 "GET /compute/v2.1/servers/30b3ffec-7110-4b4d-9482-2451914c166f" status: 200 len: 1722 microversion: 2.20 time: 1.091341 Jun 24 16:33:48.460986 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 116/212] 10.222.0.18 () {60 vars in 1276 bytes} [Fri Jun 24 16:33:47 2022] GET /compute/v2.1/servers/30b3ffec-7110-4b4d-9482-2451914c166f => generated 1722 bytes in 1095 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 16:33:48.772135 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [req-0454b2cb-0d01-4b11-9ebb-31b596fdefd5 req-fede04cc-40f2-4171-8dae-d632b5eaf8a5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2941738f-8dec-4faa-99e4-aca0a28b71e6", "name": "network-vif-unplugged", "status": "completed", "tag": "ea66b455-fbf3-476e-94fe-b88e627a3c9c"}]} {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 16:33:48.775268 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 24 16:33:48.775268 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: warnings.warn(msg) Jun 24 16:33:48.812028 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [req-0454b2cb-0d01-4b11-9ebb-31b596fdefd5 req-fede04cc-40f2-4171-8dae-d632b5eaf8a5 service nova] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:33:48.813913 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [req-0454b2cb-0d01-4b11-9ebb-31b596fdefd5 req-fede04cc-40f2-4171-8dae-d632b5eaf8a5 service nova] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:33:48.868884 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.compute.server_external_events [req-0454b2cb-0d01-4b11-9ebb-31b596fdefd5 req-fede04cc-40f2-4171-8dae-d632b5eaf8a5 service nova] Creating event network-vif-unplugged:ea66b455-fbf3-476e-94fe-b88e627a3c9c for instance 2941738f-8dec-4faa-99e4-aca0a28b71e6 on hv-cinder-84718 Jun 24 16:33:48.877812 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [req-0454b2cb-0d01-4b11-9ebb-31b596fdefd5 req-fede04cc-40f2-4171-8dae-d632b5eaf8a5 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.110519 Jun 24 16:33:48.879165 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 97/213] 10.222.0.18 () {64 vars in 1317 bytes} [Fri Jun 24 16:33:48 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 16:33:49.010107 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-9e8dbf10-13dd-4143-a0fd-032d3c8dc35e tempest-VolumesActionsTest-1515172499 tempest-VolumesActionsTest-1515172499-project] Calling method '>' {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:33:49.011025 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-9e8dbf10-13dd-4143-a0fd-032d3c8dc35e tempest-VolumesActionsTest-1515172499 tempest-VolumesActionsTest-1515172499-project] [instance: 2941738f-8dec-4faa-99e4-aca0a28b71e6] Fetching instance by UUID {{(pid=102148) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:33:49.049251 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-9e8dbf10-13dd-4143-a0fd-032d3c8dc35e tempest-VolumesActionsTest-1515172499 tempest-VolumesActionsTest-1515172499-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:33:49.050055 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-9e8dbf10-13dd-4143-a0fd-032d3c8dc35e tempest-VolumesActionsTest-1515172499 tempest-VolumesActionsTest-1515172499-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:33:49.051741 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-9e8dbf10-13dd-4143-a0fd-032d3c8dc35e tempest-VolumesActionsTest-1515172499 tempest-VolumesActionsTest-1515172499-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:33:49.052546 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-9e8dbf10-13dd-4143-a0fd-032d3c8dc35e tempest-VolumesActionsTest-1515172499 tempest-VolumesActionsTest-1515172499-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:33:49.491120 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-001828fb-3f4c-4a24-aa3a-57910a35bcc9 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Calling method '>' {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:33:49.492075 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-001828fb-3f4c-4a24-aa3a-57910a35bcc9 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] [instance: 30b3ffec-7110-4b4d-9482-2451914c166f] Fetching instance by UUID {{(pid=102149) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:33:49.512881 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-001828fb-3f4c-4a24-aa3a-57910a35bcc9 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:33:49.513361 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-001828fb-3f4c-4a24-aa3a-57910a35bcc9 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:33:49.514186 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-001828fb-3f4c-4a24-aa3a-57910a35bcc9 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:33:49.514665 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-001828fb-3f4c-4a24-aa3a-57910a35bcc9 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:33:50.250463 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-9e8dbf10-13dd-4143-a0fd-032d3c8dc35e tempest-VolumesActionsTest-1515172499 tempest-VolumesActionsTest-1515172499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dd95251dce947f8bb6a2739a6557dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fd35a8f65244b5a18f841af49d5c7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:33:50.271339 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-9e8dbf10-13dd-4143-a0fd-032d3c8dc35e tempest-VolumesActionsTest-1515172499 tempest-VolumesActionsTest-1515172499-project] 10.222.0.18 "GET /compute/v2.1/servers/2941738f-8dec-4faa-99e4-aca0a28b71e6" status: 200 len: 1503 microversion: 2.1 time: 1.267058 Jun 24 16:33:50.290060 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 117/214] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:33:49 2022] GET /compute/v2.1/servers/2941738f-8dec-4faa-99e4-aca0a28b71e6 => generated 1503 bytes in 1275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 16:33:50.507740 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-001828fb-3f4c-4a24-aa3a-57910a35bcc9 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7489b29cb3ef47d78dfd55794f338b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065254ebe67545639644fcbc6bd9fc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:33:50.534815 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-001828fb-3f4c-4a24-aa3a-57910a35bcc9 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7489b29cb3ef47d78dfd55794f338b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065254ebe67545639644fcbc6bd9fc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:33:50.544403 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-001828fb-3f4c-4a24-aa3a-57910a35bcc9 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7489b29cb3ef47d78dfd55794f338b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065254ebe67545639644fcbc6bd9fc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:33:50.551496 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-001828fb-3f4c-4a24-aa3a-57910a35bcc9 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] 10.222.0.18 "GET /compute/v2.1/servers/30b3ffec-7110-4b4d-9482-2451914c166f" status: 200 len: 1722 microversion: 2.20 time: 1.071647 Jun 24 16:33:50.553441 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 98/215] 10.222.0.18 () {60 vars in 1276 bytes} [Fri Jun 24 16:33:49 2022] GET /compute/v2.1/servers/30b3ffec-7110-4b4d-9482-2451914c166f => generated 1722 bytes in 1077 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 16:33:51.298353 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-1ca9d22c-74e6-480c-9476-b2a7be919694 tempest-VolumesActionsTest-1515172499 tempest-VolumesActionsTest-1515172499-project] Calling method '>' {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:33:51.299702 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-1ca9d22c-74e6-480c-9476-b2a7be919694 tempest-VolumesActionsTest-1515172499 tempest-VolumesActionsTest-1515172499-project] [instance: 2941738f-8dec-4faa-99e4-aca0a28b71e6] Fetching instance by UUID {{(pid=102148) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:33:51.308391 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-1ca9d22c-74e6-480c-9476-b2a7be919694 tempest-VolumesActionsTest-1515172499 tempest-VolumesActionsTest-1515172499-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:33:51.308966 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-1ca9d22c-74e6-480c-9476-b2a7be919694 tempest-VolumesActionsTest-1515172499 tempest-VolumesActionsTest-1515172499-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:33:51.310069 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-1ca9d22c-74e6-480c-9476-b2a7be919694 tempest-VolumesActionsTest-1515172499 tempest-VolumesActionsTest-1515172499-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:33:51.310577 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-1ca9d22c-74e6-480c-9476-b2a7be919694 tempest-VolumesActionsTest-1515172499 tempest-VolumesActionsTest-1515172499-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:33:51.572830 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-e5761a6c-8ef4-4de3-91a1-11f852d922e9 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Calling method '>' {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:33:51.573855 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-e5761a6c-8ef4-4de3-91a1-11f852d922e9 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] [instance: 30b3ffec-7110-4b4d-9482-2451914c166f] Fetching instance by UUID {{(pid=102149) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:33:51.601611 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-e5761a6c-8ef4-4de3-91a1-11f852d922e9 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:33:51.602861 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-e5761a6c-8ef4-4de3-91a1-11f852d922e9 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:33:51.604381 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-e5761a6c-8ef4-4de3-91a1-11f852d922e9 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:33:51.605009 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-e5761a6c-8ef4-4de3-91a1-11f852d922e9 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:33:51.631428 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-1ca9d22c-74e6-480c-9476-b2a7be919694 tempest-VolumesActionsTest-1515172499 tempest-VolumesActionsTest-1515172499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dd95251dce947f8bb6a2739a6557dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fd35a8f65244b5a18f841af49d5c7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:33:51.646552 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-1ca9d22c-74e6-480c-9476-b2a7be919694 tempest-VolumesActionsTest-1515172499 tempest-VolumesActionsTest-1515172499-project] 10.222.0.18 "GET /compute/v2.1/servers/2941738f-8dec-4faa-99e4-aca0a28b71e6" status: 200 len: 1503 microversion: 2.1 time: 0.352281 Jun 24 16:33:51.647543 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 118/216] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:33:51 2022] GET /compute/v2.1/servers/2941738f-8dec-4faa-99e4-aca0a28b71e6 => generated 1503 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 16:33:52.038373 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-e5761a6c-8ef4-4de3-91a1-11f852d922e9 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7489b29cb3ef47d78dfd55794f338b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065254ebe67545639644fcbc6bd9fc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:33:52.049299 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-e5761a6c-8ef4-4de3-91a1-11f852d922e9 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7489b29cb3ef47d78dfd55794f338b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065254ebe67545639644fcbc6bd9fc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:33:52.050849 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-e5761a6c-8ef4-4de3-91a1-11f852d922e9 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7489b29cb3ef47d78dfd55794f338b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065254ebe67545639644fcbc6bd9fc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:33:52.052197 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-e5761a6c-8ef4-4de3-91a1-11f852d922e9 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] 10.222.0.18 "GET /compute/v2.1/servers/30b3ffec-7110-4b4d-9482-2451914c166f" status: 200 len: 1722 microversion: 2.20 time: 0.484301 Jun 24 16:33:52.052750 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 99/217] 10.222.0.18 () {60 vars in 1276 bytes} [Fri Jun 24 16:33:51 2022] GET /compute/v2.1/servers/30b3ffec-7110-4b4d-9482-2451914c166f => generated 1722 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 16:33:52.234928 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-8ed325f1-d0e3-4950-92d8-9c417a9d72be tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-832224568", "imageRef": "113c9cfb-6cee-4018-9e63-66fae82b3851", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e798456c-6e0e-4eb9-9c41-fac0ea090965"}], "security_groups": [{"name": "tempest-securitygroup--299990435"}], "key_name": "tempest-keypair-554596742", "user_data": "}} {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 16:33:52.402984 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.network.neutron [None req-8ed325f1-d0e3-4950-92d8-9c417a9d72be tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] validate_networks() for [('e798456c-6e0e-4eb9-9c41-fac0ea090965', None, None, None)] {{(pid=102148) validate_networks /opt/stack/nova/nova/network/neutron.py:2367}} Jun 24 16:33:52.665842 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-62f5831a-4787-408a-b6ec-585abe3ff877 tempest-VolumesActionsTest-1515172499 tempest-VolumesActionsTest-1515172499-project] Calling method '>' {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:33:52.666433 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-62f5831a-4787-408a-b6ec-585abe3ff877 tempest-VolumesActionsTest-1515172499 tempest-VolumesActionsTest-1515172499-project] [instance: 2941738f-8dec-4faa-99e4-aca0a28b71e6] Fetching instance by UUID {{(pid=102149) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:33:52.678170 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-62f5831a-4787-408a-b6ec-585abe3ff877 tempest-VolumesActionsTest-1515172499 tempest-VolumesActionsTest-1515172499-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:33:52.678651 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-62f5831a-4787-408a-b6ec-585abe3ff877 tempest-VolumesActionsTest-1515172499 tempest-VolumesActionsTest-1515172499-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:33:52.679470 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-62f5831a-4787-408a-b6ec-585abe3ff877 tempest-VolumesActionsTest-1515172499 tempest-VolumesActionsTest-1515172499-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:33:52.679881 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-62f5831a-4787-408a-b6ec-585abe3ff877 tempest-VolumesActionsTest-1515172499 tempest-VolumesActionsTest-1515172499-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:33:52.950536 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-62f5831a-4787-408a-b6ec-585abe3ff877 tempest-VolumesActionsTest-1515172499 tempest-VolumesActionsTest-1515172499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dd95251dce947f8bb6a2739a6557dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fd35a8f65244b5a18f841af49d5c7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:33:52.968946 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-62f5831a-4787-408a-b6ec-585abe3ff877 tempest-VolumesActionsTest-1515172499 tempest-VolumesActionsTest-1515172499-project] 10.222.0.18 "GET /compute/v2.1/servers/2941738f-8dec-4faa-99e4-aca0a28b71e6" status: 200 len: 1461 microversion: 2.1 time: 0.306788 Jun 24 16:33:52.981507 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 100/218] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:33:52 2022] GET /compute/v2.1/servers/2941738f-8dec-4faa-99e4-aca0a28b71e6 => generated 1461 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 16:33:53.087970 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-18abc3fd-e976-43d4-a450-f0cd97db451c tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Calling method '>' {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:33:53.089621 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-18abc3fd-e976-43d4-a450-f0cd97db451c tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] [instance: 30b3ffec-7110-4b4d-9482-2451914c166f] Fetching instance by UUID {{(pid=102149) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:33:53.099906 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-18abc3fd-e976-43d4-a450-f0cd97db451c tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:33:53.100623 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-18abc3fd-e976-43d4-a450-f0cd97db451c tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:33:53.101686 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-18abc3fd-e976-43d4-a450-f0cd97db451c tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:33:53.102296 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-18abc3fd-e976-43d4-a450-f0cd97db451c tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:33:53.284964 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.virt.hardware [None req-8ed325f1-d0e3-4950-92d8-9c417a9d72be tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Flavor limits 0:0:0 {{(pid=102148) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 24 16:33:53.285503 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.virt.hardware [None req-8ed325f1-d0e3-4950-92d8-9c417a9d72be tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Image limits 0:0:0 {{(pid=102148) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 24 16:33:53.285992 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.virt.hardware [None req-8ed325f1-d0e3-4950-92d8-9c417a9d72be tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Flavor pref 0:0:0 {{(pid=102148) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 24 16:33:53.286743 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.virt.hardware [None req-8ed325f1-d0e3-4950-92d8-9c417a9d72be tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Image pref 0:0:0 {{(pid=102148) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 24 16:33:53.287441 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.virt.hardware [None req-8ed325f1-d0e3-4950-92d8-9c417a9d72be tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=102148) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 24 16:33:53.314251 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-8ed325f1-d0e3-4950-92d8-9c417a9d72be tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:33:53.317597 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-8ed325f1-d0e3-4950-92d8-9c417a9d72be tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:33:53.319050 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-8ed325f1-d0e3-4950-92d8-9c417a9d72be tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:33:53.320409 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-8ed325f1-d0e3-4950-92d8-9c417a9d72be tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:33:53.364520 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.quota [None req-8ed325f1-d0e3-4950-92d8-9c417a9d72be tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Getting quotas for project 09584de3a4b14c5a90eb9b1c2149d6fb. Resources: {'ram', 'instances', 'cores'} {{(pid=102148) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jun 24 16:33:53.370397 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.quota [None req-8ed325f1-d0e3-4950-92d8-9c417a9d72be tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Getting quotas for user f2c286a3f03048689e5ec552bb89c161 and project 09584de3a4b14c5a90eb9b1c2149d6fb. Resources: {'ram', 'instances', 'cores'} {{(pid=102148) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jun 24 16:33:53.397356 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-8ed325f1-d0e3-4950-92d8-9c417a9d72be tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Going to run 1 instances... {{(pid=102148) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Jun 24 16:33:53.402957 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-8ed325f1-d0e3-4950-92d8-9c417a9d72be tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] [instance: 1739cd84-3709-4cf4-95e3-82de4b4d3d7a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='113c9cfb-6cee-4018-9e63-66fae82b3851',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=102148) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1684}} Jun 24 16:33:53.492766 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-8ed325f1-d0e3-4950-92d8-9c417a9d72be tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 1.263113 Jun 24 16:33:53.501746 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 119/219] 10.222.0.18 () {60 vars in 1146 bytes} [Fri Jun 24 16:33:52 2022] POST /compute/v2.1/servers => generated 408 bytes in 1273 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 24 16:33:53.507358 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [req-888b498d-9903-436c-aec7-cb8396dd52ed req-2366eaae-dbf1-4ce0-a831-52e678c49500 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2941738f-8dec-4faa-99e4-aca0a28b71e6", "name": "network-vif-deleted", "tag": "ea66b455-fbf3-476e-94fe-b88e627a3c9c"}]} {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 16:33:53.512218 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 24 16:33:53.512218 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: warnings.warn(msg) Jun 24 16:33:53.541201 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [req-888b498d-9903-436c-aec7-cb8396dd52ed req-2366eaae-dbf1-4ce0-a831-52e678c49500 service nova] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:33:53.541603 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [req-888b498d-9903-436c-aec7-cb8396dd52ed req-2366eaae-dbf1-4ce0-a831-52e678c49500 service nova] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:33:53.562923 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-18abc3fd-e976-43d4-a450-f0cd97db451c tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7489b29cb3ef47d78dfd55794f338b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065254ebe67545639644fcbc6bd9fc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:33:53.575978 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.compute.server_external_events [req-888b498d-9903-436c-aec7-cb8396dd52ed req-2366eaae-dbf1-4ce0-a831-52e678c49500 service nova] Creating event network-vif-deleted:ea66b455-fbf3-476e-94fe-b88e627a3c9c for instance 2941738f-8dec-4faa-99e4-aca0a28b71e6 on hv-cinder-84718 Jun 24 16:33:53.587372 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-18abc3fd-e976-43d4-a450-f0cd97db451c tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7489b29cb3ef47d78dfd55794f338b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065254ebe67545639644fcbc6bd9fc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:33:53.589223 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [req-888b498d-9903-436c-aec7-cb8396dd52ed req-2366eaae-dbf1-4ce0-a831-52e678c49500 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085891 Jun 24 16:33:53.590000 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 120/220] 10.222.0.18 () {64 vars in 1317 bytes} [Fri Jun 24 16:33:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 16:33:53.591947 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-18abc3fd-e976-43d4-a450-f0cd97db451c tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7489b29cb3ef47d78dfd55794f338b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065254ebe67545639644fcbc6bd9fc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:33:53.594438 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-18abc3fd-e976-43d4-a450-f0cd97db451c tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] 10.222.0.18 "GET /compute/v2.1/servers/30b3ffec-7110-4b4d-9482-2451914c166f" status: 200 len: 1722 microversion: 2.20 time: 0.513588 Jun 24 16:33:53.595964 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 101/221] 10.222.0.18 () {60 vars in 1276 bytes} [Fri Jun 24 16:33:53 2022] GET /compute/v2.1/servers/30b3ffec-7110-4b4d-9482-2451914c166f => generated 1722 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 16:33:53.603852 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-f5c32808-36f9-471e-874f-a42ddfb3500c tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Calling method '>' {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:33:53.604591 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-f5c32808-36f9-471e-874f-a42ddfb3500c tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] [instance: 1739cd84-3709-4cf4-95e3-82de4b4d3d7a] Fetching instance by UUID {{(pid=102148) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:33:53.720992 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-f5c32808-36f9-471e-874f-a42ddfb3500c tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c286a3f03048689e5ec552bb89c161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09584de3a4b14c5a90eb9b1c2149d6fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:33:53.739407 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-f5c32808-36f9-471e-874f-a42ddfb3500c tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] 10.222.0.18 "GET /compute/v2.1/servers/1739cd84-3709-4cf4-95e3-82de4b4d3d7a" status: 200 len: 1244 microversion: 2.1 time: 0.147304 Jun 24 16:33:53.740210 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 121/222] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:33:53 2022] GET /compute/v2.1/servers/1739cd84-3709-4cf4-95e3-82de4b4d3d7a => generated 1244 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 16:33:54.014281 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-57f36592-3bbd-4865-aafe-048131915607 tempest-VolumesActionsTest-1515172499 tempest-VolumesActionsTest-1515172499-project] Calling method '>' {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:33:54.018150 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-57f36592-3bbd-4865-aafe-048131915607 tempest-VolumesActionsTest-1515172499 tempest-VolumesActionsTest-1515172499-project] [instance: 2941738f-8dec-4faa-99e4-aca0a28b71e6] Fetching instance by UUID {{(pid=102149) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:33:54.053964 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-57f36592-3bbd-4865-aafe-048131915607 tempest-VolumesActionsTest-1515172499 tempest-VolumesActionsTest-1515172499-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:33:54.054417 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-57f36592-3bbd-4865-aafe-048131915607 tempest-VolumesActionsTest-1515172499 tempest-VolumesActionsTest-1515172499-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:33:54.063558 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-57f36592-3bbd-4865-aafe-048131915607 tempest-VolumesActionsTest-1515172499 tempest-VolumesActionsTest-1515172499-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:33:54.066341 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-57f36592-3bbd-4865-aafe-048131915607 tempest-VolumesActionsTest-1515172499 tempest-VolumesActionsTest-1515172499-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:33:54.219277 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-57f36592-3bbd-4865-aafe-048131915607 tempest-VolumesActionsTest-1515172499 tempest-VolumesActionsTest-1515172499-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:33:54.220261 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-57f36592-3bbd-4865-aafe-048131915607 tempest-VolumesActionsTest-1515172499 tempest-VolumesActionsTest-1515172499-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:33:54.221450 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.objects.instance [None req-57f36592-3bbd-4865-aafe-048131915607 tempest-VolumesActionsTest-1515172499 tempest-VolumesActionsTest-1515172499-project] Lazy-loading 'fault' on Instance uuid 2941738f-8dec-4faa-99e4-aca0a28b71e6 {{(pid=102149) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Jun 24 16:33:54.408790 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-57f36592-3bbd-4865-aafe-048131915607 tempest-VolumesActionsTest-1515172499 tempest-VolumesActionsTest-1515172499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dd95251dce947f8bb6a2739a6557dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fd35a8f65244b5a18f841af49d5c7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:33:54.436840 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-57f36592-3bbd-4865-aafe-048131915607 tempest-VolumesActionsTest-1515172499 tempest-VolumesActionsTest-1515172499-project] 10.222.0.18 "GET /compute/v2.1/servers/2941738f-8dec-4faa-99e4-aca0a28b71e6" status: 200 len: 1304 microversion: 2.1 time: 0.448466 Jun 24 16:33:54.443322 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 102/223] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:33:53 2022] GET /compute/v2.1/servers/2941738f-8dec-4faa-99e4-aca0a28b71e6 => generated 1304 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 16:33:54.627516 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-d2cdc7f8-2b5c-4f5d-887c-4b692513a61f tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Calling method '>' {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:33:54.634589 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-d2cdc7f8-2b5c-4f5d-887c-4b692513a61f tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] [instance: 30b3ffec-7110-4b4d-9482-2451914c166f] Fetching instance by UUID {{(pid=102148) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:33:54.663181 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-d2cdc7f8-2b5c-4f5d-887c-4b692513a61f tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:33:54.663974 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-d2cdc7f8-2b5c-4f5d-887c-4b692513a61f tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:33:54.672326 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-d2cdc7f8-2b5c-4f5d-887c-4b692513a61f tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:33:54.673703 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-d2cdc7f8-2b5c-4f5d-887c-4b692513a61f tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:33:54.767001 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-3ded3220-759f-4623-b77c-6f288c27cb22 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Calling method '>' {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:33:54.768259 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-3ded3220-759f-4623-b77c-6f288c27cb22 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] [instance: 1739cd84-3709-4cf4-95e3-82de4b4d3d7a] Fetching instance by UUID {{(pid=102149) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:33:54.796769 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-3ded3220-759f-4623-b77c-6f288c27cb22 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:33:54.799319 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-3ded3220-759f-4623-b77c-6f288c27cb22 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:33:54.803193 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-3ded3220-759f-4623-b77c-6f288c27cb22 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:33:54.805791 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-3ded3220-759f-4623-b77c-6f288c27cb22 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:33:55.219500 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-3ded3220-759f-4623-b77c-6f288c27cb22 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c286a3f03048689e5ec552bb89c161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09584de3a4b14c5a90eb9b1c2149d6fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:33:55.235704 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-3ded3220-759f-4623-b77c-6f288c27cb22 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] 10.222.0.18 "GET /compute/v2.1/servers/1739cd84-3709-4cf4-95e3-82de4b4d3d7a" status: 200 len: 1240 microversion: 2.1 time: 0.475092 Jun 24 16:33:55.237606 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 103/224] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:33:54 2022] GET /compute/v2.1/servers/1739cd84-3709-4cf4-95e3-82de4b4d3d7a => generated 1240 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 16:33:55.426191 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-d2cdc7f8-2b5c-4f5d-887c-4b692513a61f tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7489b29cb3ef47d78dfd55794f338b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065254ebe67545639644fcbc6bd9fc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:33:55.438341 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-d2cdc7f8-2b5c-4f5d-887c-4b692513a61f tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7489b29cb3ef47d78dfd55794f338b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065254ebe67545639644fcbc6bd9fc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:33:55.440154 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-d2cdc7f8-2b5c-4f5d-887c-4b692513a61f tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7489b29cb3ef47d78dfd55794f338b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065254ebe67545639644fcbc6bd9fc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:33:55.441651 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-d2cdc7f8-2b5c-4f5d-887c-4b692513a61f tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] 10.222.0.18 "GET /compute/v2.1/servers/30b3ffec-7110-4b4d-9482-2451914c166f" status: 200 len: 1722 microversion: 2.20 time: 0.830052 Jun 24 16:33:55.454431 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 122/225] 10.222.0.18 () {60 vars in 1276 bytes} [Fri Jun 24 16:33:54 2022] GET /compute/v2.1/servers/30b3ffec-7110-4b4d-9482-2451914c166f => generated 1722 bytes in 844 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 16:33:55.474884 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-c21b1ca2-430c-4591-a08e-45ac77c3e73f tempest-VolumesActionsTest-1515172499 tempest-VolumesActionsTest-1515172499-project] Calling method '>' {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:33:55.476511 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-c21b1ca2-430c-4591-a08e-45ac77c3e73f tempest-VolumesActionsTest-1515172499 tempest-VolumesActionsTest-1515172499-project] [instance: 2941738f-8dec-4faa-99e4-aca0a28b71e6] Fetching instance by UUID {{(pid=102149) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:33:55.495230 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-c21b1ca2-430c-4591-a08e-45ac77c3e73f tempest-VolumesActionsTest-1515172499 tempest-VolumesActionsTest-1515172499-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:33:55.496513 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-c21b1ca2-430c-4591-a08e-45ac77c3e73f tempest-VolumesActionsTest-1515172499 tempest-VolumesActionsTest-1515172499-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:33:55.507578 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-c21b1ca2-430c-4591-a08e-45ac77c3e73f tempest-VolumesActionsTest-1515172499 tempest-VolumesActionsTest-1515172499-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:33:55.509194 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-c21b1ca2-430c-4591-a08e-45ac77c3e73f tempest-VolumesActionsTest-1515172499 tempest-VolumesActionsTest-1515172499-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:33:55.527575 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-57c8aca8-dab6-4418-b0bc-07b65e410084 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Action: 'create', calling method: .version_select at 0x7f1ae80efd30>, body: {"keypair": {"name": "tempest-keypair-494932195", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDleAmIa/w2JDC4jSzlrGRoH8OfJ15CgOi6SXZcdmVkJW5oL7+M39ClGpKwNOK5t4cib9Mve92agQJAjj+zF8vchAg8GNvuweHGGsO9zqwx0SAH0GGu4S40w/Rjn45hieQ=="}} {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 16:33:55.583212 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.quota [None req-57c8aca8-dab6-4418-b0bc-07b65e410084 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Getting quotas for project 606ba814a2d8408ab0856d539ca79b4f. Resources: {'key_pairs'} {{(pid=102148) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jun 24 16:33:55.591830 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.quota [None req-57c8aca8-dab6-4418-b0bc-07b65e410084 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Getting quotas for user 499faf87cf8c41ae823b2566e4c2d8ce and project 606ba814a2d8408ab0856d539ca79b4f. Resources: {'key_pairs'} {{(pid=102148) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jun 24 16:33:55.660454 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-57c8aca8-dab6-4418-b0bc-07b65e410084 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.138468 Jun 24 16:33:55.668398 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.wsgi [None req-c21b1ca2-430c-4591-a08e-45ac77c3e73f tempest-VolumesActionsTest-1515172499 tempest-VolumesActionsTest-1515172499-project] HTTP exception thrown: Instance 2941738f-8dec-4faa-99e4-aca0a28b71e6 could not be found. Jun 24 16:33:55.671092 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 123/226] 10.222.0.18 () {60 vars in 1158 bytes} [Fri Jun 24 16:33:55 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 16:33:55.674535 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-c21b1ca2-430c-4591-a08e-45ac77c3e73f tempest-VolumesActionsTest-1515172499 tempest-VolumesActionsTest-1515172499-project] Returning 404 to user: Instance 2941738f-8dec-4faa-99e4-aca0a28b71e6 could not be found. {{(pid=102149) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jun 24 16:33:55.679091 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-c21b1ca2-430c-4591-a08e-45ac77c3e73f tempest-VolumesActionsTest-1515172499 tempest-VolumesActionsTest-1515172499-project] 10.222.0.18 "GET /compute/v2.1/servers/2941738f-8dec-4faa-99e4-aca0a28b71e6" status: 404 len: 111 microversion: 2.1 time: 0.212697 Jun 24 16:33:55.681560 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 104/227] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:33:55 2022] GET /compute/v2.1/servers/2941738f-8dec-4faa-99e4-aca0a28b71e6 => generated 111 bytes in 216 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 16:33:56.256826 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-53e06bb8-348a-4a0c-8963-f3f7afeed7c3 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Calling method '>' {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:33:56.257995 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-53e06bb8-348a-4a0c-8963-f3f7afeed7c3 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] [instance: 1739cd84-3709-4cf4-95e3-82de4b4d3d7a] Fetching instance by UUID {{(pid=102148) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:33:56.322544 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-53e06bb8-348a-4a0c-8963-f3f7afeed7c3 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:33:56.323433 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-53e06bb8-348a-4a0c-8963-f3f7afeed7c3 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:33:56.324563 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-53e06bb8-348a-4a0c-8963-f3f7afeed7c3 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:33:56.325139 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-53e06bb8-348a-4a0c-8963-f3f7afeed7c3 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:33:56.465513 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-74f7c1d8-c58d-458c-9758-cb997ae20464 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Calling method '>' {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:33:56.467417 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-74f7c1d8-c58d-458c-9758-cb997ae20464 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] [instance: 30b3ffec-7110-4b4d-9482-2451914c166f] Fetching instance by UUID {{(pid=102149) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:33:56.503350 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-74f7c1d8-c58d-458c-9758-cb997ae20464 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:33:56.504729 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-74f7c1d8-c58d-458c-9758-cb997ae20464 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:33:56.506600 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-74f7c1d8-c58d-458c-9758-cb997ae20464 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:33:56.507560 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-74f7c1d8-c58d-458c-9758-cb997ae20464 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:33:56.945160 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-53e06bb8-348a-4a0c-8963-f3f7afeed7c3 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c286a3f03048689e5ec552bb89c161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09584de3a4b14c5a90eb9b1c2149d6fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:33:56.977337 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-53e06bb8-348a-4a0c-8963-f3f7afeed7c3 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] 10.222.0.18 "GET /compute/v2.1/servers/1739cd84-3709-4cf4-95e3-82de4b4d3d7a" status: 200 len: 1314 microversion: 2.1 time: 0.725532 Jun 24 16:33:56.978293 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 124/228] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:33:56 2022] GET /compute/v2.1/servers/1739cd84-3709-4cf4-95e3-82de4b4d3d7a => generated 1314 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 16:33:57.414121 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-74f7c1d8-c58d-458c-9758-cb997ae20464 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7489b29cb3ef47d78dfd55794f338b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065254ebe67545639644fcbc6bd9fc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:33:57.465867 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-74f7c1d8-c58d-458c-9758-cb997ae20464 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7489b29cb3ef47d78dfd55794f338b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065254ebe67545639644fcbc6bd9fc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:33:57.472529 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-74f7c1d8-c58d-458c-9758-cb997ae20464 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7489b29cb3ef47d78dfd55794f338b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065254ebe67545639644fcbc6bd9fc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:33:57.496945 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-74f7c1d8-c58d-458c-9758-cb997ae20464 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] 10.222.0.18 "GET /compute/v2.1/servers/30b3ffec-7110-4b4d-9482-2451914c166f" status: 200 len: 1722 microversion: 2.20 time: 1.033003 Jun 24 16:33:57.509894 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 105/229] 10.222.0.18 () {60 vars in 1276 bytes} [Fri Jun 24 16:33:56 2022] GET /compute/v2.1/servers/30b3ffec-7110-4b4d-9482-2451914c166f => generated 1722 bytes in 1047 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 16:33:58.002818 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-a5f5a9c4-34f1-43f2-8de3-1bf1a20f8ca9 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Calling method '>' {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:33:58.003772 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-a5f5a9c4-34f1-43f2-8de3-1bf1a20f8ca9 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] [instance: 1739cd84-3709-4cf4-95e3-82de4b4d3d7a] Fetching instance by UUID {{(pid=102148) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:33:58.021464 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-a5f5a9c4-34f1-43f2-8de3-1bf1a20f8ca9 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:33:58.022070 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-a5f5a9c4-34f1-43f2-8de3-1bf1a20f8ca9 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:33:58.022703 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-a5f5a9c4-34f1-43f2-8de3-1bf1a20f8ca9 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:33:58.023145 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-a5f5a9c4-34f1-43f2-8de3-1bf1a20f8ca9 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:33:58.438353 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-a5f5a9c4-34f1-43f2-8de3-1bf1a20f8ca9 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c286a3f03048689e5ec552bb89c161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09584de3a4b14c5a90eb9b1c2149d6fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:33:58.456690 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-a5f5a9c4-34f1-43f2-8de3-1bf1a20f8ca9 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] 10.222.0.18 "GET /compute/v2.1/servers/1739cd84-3709-4cf4-95e3-82de4b4d3d7a" status: 200 len: 1302 microversion: 2.1 time: 0.459946 Jun 24 16:33:58.475348 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 125/230] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:33:57 2022] GET /compute/v2.1/servers/1739cd84-3709-4cf4-95e3-82de4b4d3d7a => generated 1302 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 16:33:58.525561 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-41f06ce8-c917-40c0-8af4-641d49051094 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Calling method '>' {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:33:58.526363 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-41f06ce8-c917-40c0-8af4-641d49051094 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] [instance: 30b3ffec-7110-4b4d-9482-2451914c166f] Fetching instance by UUID {{(pid=102149) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:33:58.536964 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-41f06ce8-c917-40c0-8af4-641d49051094 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:33:58.537881 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-41f06ce8-c917-40c0-8af4-641d49051094 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:33:58.539094 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-41f06ce8-c917-40c0-8af4-641d49051094 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:33:58.539714 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-41f06ce8-c917-40c0-8af4-641d49051094 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:33:59.229128 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-41f06ce8-c917-40c0-8af4-641d49051094 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7489b29cb3ef47d78dfd55794f338b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065254ebe67545639644fcbc6bd9fc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:33:59.284223 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-41f06ce8-c917-40c0-8af4-641d49051094 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7489b29cb3ef47d78dfd55794f338b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065254ebe67545639644fcbc6bd9fc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:33:59.287678 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-41f06ce8-c917-40c0-8af4-641d49051094 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7489b29cb3ef47d78dfd55794f338b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065254ebe67545639644fcbc6bd9fc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:33:59.292886 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-41f06ce8-c917-40c0-8af4-641d49051094 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] 10.222.0.18 "GET /compute/v2.1/servers/30b3ffec-7110-4b4d-9482-2451914c166f" status: 200 len: 1722 microversion: 2.20 time: 0.771744 Jun 24 16:33:59.296538 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 106/231] 10.222.0.18 () {60 vars in 1276 bytes} [Fri Jun 24 16:33:58 2022] GET /compute/v2.1/servers/30b3ffec-7110-4b4d-9482-2451914c166f => generated 1722 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 16:33:59.485463 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-e826512a-02a9-47c0-a653-da392ed596d5 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Calling method '>' {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:33:59.487495 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-e826512a-02a9-47c0-a653-da392ed596d5 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] [instance: 1739cd84-3709-4cf4-95e3-82de4b4d3d7a] Fetching instance by UUID {{(pid=102148) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:33:59.524085 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-e826512a-02a9-47c0-a653-da392ed596d5 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:33:59.524813 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-e826512a-02a9-47c0-a653-da392ed596d5 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:33:59.531207 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-e826512a-02a9-47c0-a653-da392ed596d5 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:33:59.532434 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-e826512a-02a9-47c0-a653-da392ed596d5 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:33:59.742871 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-e826512a-02a9-47c0-a653-da392ed596d5 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c286a3f03048689e5ec552bb89c161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09584de3a4b14c5a90eb9b1c2149d6fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:33:59.753483 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-e826512a-02a9-47c0-a653-da392ed596d5 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] 10.222.0.18 "GET /compute/v2.1/servers/1739cd84-3709-4cf4-95e3-82de4b4d3d7a" status: 200 len: 1302 microversion: 2.1 time: 0.274305 Jun 24 16:33:59.756348 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 126/232] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:33:59 2022] GET /compute/v2.1/servers/1739cd84-3709-4cf4-95e3-82de4b4d3d7a => generated 1302 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 16:34:00.120914 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-4b9b901a-21f3-4e98-9e81-71ddb5d885d4 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1689151344", "imageRef": "113c9cfb-6cee-4018-9e63-66fae82b3851", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "45be4882-d29a-4ee7-b3ed-ba8729666ff7"}], "security_groups": [{"name": "tempest-securitygroup--950904654"}], "key_name": "tempest-keypair-494932195", "user_data": "}} {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 16:34:00.335362 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-05454c3c-c318-40d6-91fc-142284067555 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Calling method '>' {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:34:00.336167 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-05454c3c-c318-40d6-91fc-142284067555 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] [instance: 30b3ffec-7110-4b4d-9482-2451914c166f] Fetching instance by UUID {{(pid=102148) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:34:00.349469 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-05454c3c-c318-40d6-91fc-142284067555 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:34:00.354570 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.network.neutron [None req-4b9b901a-21f3-4e98-9e81-71ddb5d885d4 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] validate_networks() for [('45be4882-d29a-4ee7-b3ed-ba8729666ff7', None, None, None)] {{(pid=102149) validate_networks /opt/stack/nova/nova/network/neutron.py:2367}} Jun 24 16:34:00.355955 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-05454c3c-c318-40d6-91fc-142284067555 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:34:00.357469 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-05454c3c-c318-40d6-91fc-142284067555 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:34:00.357944 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-05454c3c-c318-40d6-91fc-142284067555 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:34:01.000423 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-05454c3c-c318-40d6-91fc-142284067555 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7489b29cb3ef47d78dfd55794f338b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065254ebe67545639644fcbc6bd9fc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:34:01.012488 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-05454c3c-c318-40d6-91fc-142284067555 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7489b29cb3ef47d78dfd55794f338b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065254ebe67545639644fcbc6bd9fc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:34:01.014240 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-05454c3c-c318-40d6-91fc-142284067555 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7489b29cb3ef47d78dfd55794f338b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065254ebe67545639644fcbc6bd9fc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:34:01.015574 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-05454c3c-c318-40d6-91fc-142284067555 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] 10.222.0.18 "GET /compute/v2.1/servers/30b3ffec-7110-4b4d-9482-2451914c166f" status: 200 len: 1722 microversion: 2.20 time: 0.684989 Jun 24 16:34:01.016153 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 127/233] 10.222.0.18 () {60 vars in 1276 bytes} [Fri Jun 24 16:34:00 2022] GET /compute/v2.1/servers/30b3ffec-7110-4b4d-9482-2451914c166f => generated 1722 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 16:34:01.032906 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-59188baa-f580-4ce6-9356-a46ae0510356 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Calling method '>' {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:34:01.033757 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-59188baa-f580-4ce6-9356-a46ae0510356 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] [instance: 1739cd84-3709-4cf4-95e3-82de4b4d3d7a] Fetching instance by UUID {{(pid=102148) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:34:01.060505 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-59188baa-f580-4ce6-9356-a46ae0510356 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:34:01.061574 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-59188baa-f580-4ce6-9356-a46ae0510356 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:34:01.063978 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-59188baa-f580-4ce6-9356-a46ae0510356 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:34:01.064940 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-59188baa-f580-4ce6-9356-a46ae0510356 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:34:01.352172 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-59188baa-f580-4ce6-9356-a46ae0510356 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c286a3f03048689e5ec552bb89c161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09584de3a4b14c5a90eb9b1c2149d6fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:34:01.383750 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-59188baa-f580-4ce6-9356-a46ae0510356 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] 10.222.0.18 "GET /compute/v2.1/servers/1739cd84-3709-4cf4-95e3-82de4b4d3d7a" status: 200 len: 1302 microversion: 2.1 time: 0.354474 Jun 24 16:34:01.387599 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 128/234] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:34:01 2022] GET /compute/v2.1/servers/1739cd84-3709-4cf4-95e3-82de4b4d3d7a => generated 1302 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 16:34:01.774631 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.virt.hardware [None req-4b9b901a-21f3-4e98-9e81-71ddb5d885d4 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Flavor limits 0:0:0 {{(pid=102149) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 24 16:34:01.775698 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.virt.hardware [None req-4b9b901a-21f3-4e98-9e81-71ddb5d885d4 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Image limits 0:0:0 {{(pid=102149) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 24 16:34:01.777379 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.virt.hardware [None req-4b9b901a-21f3-4e98-9e81-71ddb5d885d4 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Flavor pref 0:0:0 {{(pid=102149) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 24 16:34:01.778136 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.virt.hardware [None req-4b9b901a-21f3-4e98-9e81-71ddb5d885d4 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Image pref 0:0:0 {{(pid=102149) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 24 16:34:01.779050 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.virt.hardware [None req-4b9b901a-21f3-4e98-9e81-71ddb5d885d4 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=102149) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 24 16:34:01.796439 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-4b9b901a-21f3-4e98-9e81-71ddb5d885d4 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:34:01.797786 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-4b9b901a-21f3-4e98-9e81-71ddb5d885d4 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:34:01.799698 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-4b9b901a-21f3-4e98-9e81-71ddb5d885d4 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:34:01.800427 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-4b9b901a-21f3-4e98-9e81-71ddb5d885d4 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:34:01.834776 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.quota [None req-4b9b901a-21f3-4e98-9e81-71ddb5d885d4 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Getting quotas for project 606ba814a2d8408ab0856d539ca79b4f. Resources: {'ram', 'instances', 'cores'} {{(pid=102149) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jun 24 16:34:01.842342 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.quota [None req-4b9b901a-21f3-4e98-9e81-71ddb5d885d4 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Getting quotas for user 499faf87cf8c41ae823b2566e4c2d8ce and project 606ba814a2d8408ab0856d539ca79b4f. Resources: {'ram', 'instances', 'cores'} {{(pid=102149) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jun 24 16:34:01.861308 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-4b9b901a-21f3-4e98-9e81-71ddb5d885d4 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Going to run 1 instances... {{(pid=102149) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Jun 24 16:34:01.865748 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-4b9b901a-21f3-4e98-9e81-71ddb5d885d4 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] [instance: 24dce890-4ccc-4122-8b62-438ea395fb9a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='113c9cfb-6cee-4018-9e63-66fae82b3851',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=102149) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1684}} Jun 24 16:34:01.938966 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-4b9b901a-21f3-4e98-9e81-71ddb5d885d4 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.821787 Jun 24 16:34:01.943982 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 107/235] 10.222.0.18 () {60 vars in 1146 bytes} [Fri Jun 24 16:34:00 2022] POST /compute/v2.1/servers => generated 401 bytes in 1824 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 24 16:34:01.958071 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-4f3c5bfd-98c9-4e20-89a1-b9cf44713cba tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Calling method '>' {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:34:01.959228 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-4f3c5bfd-98c9-4e20-89a1-b9cf44713cba tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] [instance: 24dce890-4ccc-4122-8b62-438ea395fb9a] Fetching instance by UUID {{(pid=102148) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:34:02.048565 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-c2527f43-3a27-4845-a9ee-ffd7a388ede3 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Calling method '>' {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:34:02.053813 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-c2527f43-3a27-4845-a9ee-ffd7a388ede3 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] [instance: 30b3ffec-7110-4b4d-9482-2451914c166f] Fetching instance by UUID {{(pid=102149) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:34:02.064594 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-c2527f43-3a27-4845-a9ee-ffd7a388ede3 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:34:02.065205 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-c2527f43-3a27-4845-a9ee-ffd7a388ede3 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:34:02.066452 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-c2527f43-3a27-4845-a9ee-ffd7a388ede3 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:34:02.067102 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-c2527f43-3a27-4845-a9ee-ffd7a388ede3 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:34:02.117695 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-4f3c5bfd-98c9-4e20-89a1-b9cf44713cba tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '499faf87cf8c41ae823b2566e4c2d8ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606ba814a2d8408ab0856d539ca79b4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:34:02.128216 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-4f3c5bfd-98c9-4e20-89a1-b9cf44713cba tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] 10.222.0.18 "GET /compute/v2.1/servers/24dce890-4ccc-4122-8b62-438ea395fb9a" status: 200 len: 1241 microversion: 2.1 time: 0.177911 Jun 24 16:34:02.129721 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 129/236] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:34:01 2022] GET /compute/v2.1/servers/24dce890-4ccc-4122-8b62-438ea395fb9a => generated 1241 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 16:34:02.416323 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-a91b76db-0ece-42a9-84b2-753ce46c5ddb tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Calling method '>' {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:34:02.417108 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-a91b76db-0ece-42a9-84b2-753ce46c5ddb tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] [instance: 1739cd84-3709-4cf4-95e3-82de4b4d3d7a] Fetching instance by UUID {{(pid=102148) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:34:02.466301 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-a91b76db-0ece-42a9-84b2-753ce46c5ddb tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:34:02.483459 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-a91b76db-0ece-42a9-84b2-753ce46c5ddb tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:34:02.485984 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-a91b76db-0ece-42a9-84b2-753ce46c5ddb tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:34:02.492592 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-a91b76db-0ece-42a9-84b2-753ce46c5ddb tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:34:02.637213 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-c2527f43-3a27-4845-a9ee-ffd7a388ede3 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7489b29cb3ef47d78dfd55794f338b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065254ebe67545639644fcbc6bd9fc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:34:02.649543 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-c2527f43-3a27-4845-a9ee-ffd7a388ede3 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7489b29cb3ef47d78dfd55794f338b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065254ebe67545639644fcbc6bd9fc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:34:02.657287 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-c2527f43-3a27-4845-a9ee-ffd7a388ede3 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7489b29cb3ef47d78dfd55794f338b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065254ebe67545639644fcbc6bd9fc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:34:02.663054 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-c2527f43-3a27-4845-a9ee-ffd7a388ede3 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] 10.222.0.18 "GET /compute/v2.1/servers/30b3ffec-7110-4b4d-9482-2451914c166f" status: 200 len: 1722 microversion: 2.20 time: 0.618955 Jun 24 16:34:02.668460 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 108/237] 10.222.0.18 () {60 vars in 1276 bytes} [Fri Jun 24 16:34:02 2022] GET /compute/v2.1/servers/30b3ffec-7110-4b4d-9482-2451914c166f => generated 1722 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 16:34:03.109661 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-a91b76db-0ece-42a9-84b2-753ce46c5ddb tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c286a3f03048689e5ec552bb89c161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09584de3a4b14c5a90eb9b1c2149d6fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:34:03.128516 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-a91b76db-0ece-42a9-84b2-753ce46c5ddb tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] 10.222.0.18 "GET /compute/v2.1/servers/1739cd84-3709-4cf4-95e3-82de4b4d3d7a" status: 200 len: 1369 microversion: 2.1 time: 0.717797 Jun 24 16:34:03.142286 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 130/238] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:34:02 2022] GET /compute/v2.1/servers/1739cd84-3709-4cf4-95e3-82de4b4d3d7a => generated 1369 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 16:34:03.155758 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-a9512bac-edee-4985-b47f-c8025762d4eb tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Calling method '>' {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:34:03.157116 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-a9512bac-edee-4985-b47f-c8025762d4eb tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] [instance: 24dce890-4ccc-4122-8b62-438ea395fb9a] Fetching instance by UUID {{(pid=102148) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:34:03.169624 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-a9512bac-edee-4985-b47f-c8025762d4eb tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:34:03.170815 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-a9512bac-edee-4985-b47f-c8025762d4eb tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:34:03.173120 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-a9512bac-edee-4985-b47f-c8025762d4eb tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:34:03.174356 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-a9512bac-edee-4985-b47f-c8025762d4eb tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:34:03.336906 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-61252673-4554-4385-9968-87d9b9fec0e8 tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Action: 'create', calling method: .version_select at 0x7f1ae852ea60>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-306670203", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCzyKxjh7K9LjqPixFbu5UYqbMjIKCO7FtbT1RByYlHtDoyCx/aodDuUorrPeSwmaA9gwlpxtueysBZh0Kcim0o5Gghi6C3maqzCIUIR5PhwmzL4DAAoutSo3BKilTJcHw=="}} {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 16:34:03.432351 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.quota [None req-61252673-4554-4385-9968-87d9b9fec0e8 tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Getting quotas for project 901fbc33d59d49f8afa7f06d62e19e16. Resources: {'key_pairs'} {{(pid=102149) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jun 24 16:34:03.450110 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.quota [None req-61252673-4554-4385-9968-87d9b9fec0e8 tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Getting quotas for user 65d11cab328748d5a8f5e55eb439e334 and project 901fbc33d59d49f8afa7f06d62e19e16. Resources: {'key_pairs'} {{(pid=102149) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jun 24 16:34:03.525827 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-61252673-4554-4385-9968-87d9b9fec0e8 tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.807438 Jun 24 16:34:03.529597 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 109/239] 10.222.0.18 () {60 vars in 1158 bytes} [Fri Jun 24 16:34:02 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 813 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 16:34:03.584283 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-a9512bac-edee-4985-b47f-c8025762d4eb tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '499faf87cf8c41ae823b2566e4c2d8ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606ba814a2d8408ab0856d539ca79b4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:34:03.611670 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-a9512bac-edee-4985-b47f-c8025762d4eb tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] 10.222.0.18 "GET /compute/v2.1/servers/24dce890-4ccc-4122-8b62-438ea395fb9a" status: 200 len: 1245 microversion: 2.1 time: 0.467214 Jun 24 16:34:03.638816 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 131/240] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:34:03 2022] GET /compute/v2.1/servers/24dce890-4ccc-4122-8b62-438ea395fb9a => generated 1245 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 16:34:03.703333 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-3873a8e8-0e40-4f2d-9929-a3b21abcb2c2 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Calling method '>' {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:34:03.707893 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-3873a8e8-0e40-4f2d-9929-a3b21abcb2c2 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] [instance: 30b3ffec-7110-4b4d-9482-2451914c166f] Fetching instance by UUID {{(pid=102149) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:34:03.728141 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-3873a8e8-0e40-4f2d-9929-a3b21abcb2c2 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:34:03.729406 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-3873a8e8-0e40-4f2d-9929-a3b21abcb2c2 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:34:03.732426 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-3873a8e8-0e40-4f2d-9929-a3b21abcb2c2 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:34:03.734188 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-3873a8e8-0e40-4f2d-9929-a3b21abcb2c2 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:34:04.165544 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-a72ad2dc-ee28-4208-9d87-3f3dbc9f8ca4 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Calling method '>' {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:34:04.167851 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-a72ad2dc-ee28-4208-9d87-3f3dbc9f8ca4 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] [instance: 1739cd84-3709-4cf4-95e3-82de4b4d3d7a] Fetching instance by UUID {{(pid=102148) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:34:04.209371 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-a72ad2dc-ee28-4208-9d87-3f3dbc9f8ca4 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:34:04.215986 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-a72ad2dc-ee28-4208-9d87-3f3dbc9f8ca4 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:34:04.217981 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-a72ad2dc-ee28-4208-9d87-3f3dbc9f8ca4 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:34:04.224112 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-a72ad2dc-ee28-4208-9d87-3f3dbc9f8ca4 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:34:04.935779 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-3873a8e8-0e40-4f2d-9929-a3b21abcb2c2 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7489b29cb3ef47d78dfd55794f338b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065254ebe67545639644fcbc6bd9fc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:34:04.961936 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-3873a8e8-0e40-4f2d-9929-a3b21abcb2c2 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7489b29cb3ef47d78dfd55794f338b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065254ebe67545639644fcbc6bd9fc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:34:04.972294 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-3873a8e8-0e40-4f2d-9929-a3b21abcb2c2 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7489b29cb3ef47d78dfd55794f338b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065254ebe67545639644fcbc6bd9fc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:34:04.974781 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-3873a8e8-0e40-4f2d-9929-a3b21abcb2c2 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] 10.222.0.18 "GET /compute/v2.1/servers/30b3ffec-7110-4b4d-9482-2451914c166f" status: 200 len: 1743 microversion: 2.20 time: 1.283358 Jun 24 16:34:04.980010 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 110/241] 10.222.0.18 () {60 vars in 1276 bytes} [Fri Jun 24 16:34:03 2022] GET /compute/v2.1/servers/30b3ffec-7110-4b4d-9482-2451914c166f => generated 1743 bytes in 1290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 16:34:04.997108 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-44fd5308-d2d8-4c00-b34f-3700dcca87a3 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Calling method '>' {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:34:05.001289 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-44fd5308-d2d8-4c00-b34f-3700dcca87a3 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] [instance: 24dce890-4ccc-4122-8b62-438ea395fb9a] Fetching instance by UUID {{(pid=102149) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:34:05.036752 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-44fd5308-d2d8-4c00-b34f-3700dcca87a3 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:34:05.038729 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-44fd5308-d2d8-4c00-b34f-3700dcca87a3 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:34:05.043811 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-44fd5308-d2d8-4c00-b34f-3700dcca87a3 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:34:05.045276 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-44fd5308-d2d8-4c00-b34f-3700dcca87a3 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:34:06.404515 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-44fd5308-d2d8-4c00-b34f-3700dcca87a3 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '499faf87cf8c41ae823b2566e4c2d8ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606ba814a2d8408ab0856d539ca79b4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:34:06.419509 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-44fd5308-d2d8-4c00-b34f-3700dcca87a3 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] 10.222.0.18 "GET /compute/v2.1/servers/24dce890-4ccc-4122-8b62-438ea395fb9a" status: 200 len: 1311 microversion: 2.1 time: 1.437798 Jun 24 16:34:06.432244 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 111/242] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:34:04 2022] GET /compute/v2.1/servers/24dce890-4ccc-4122-8b62-438ea395fb9a => generated 1311 bytes in 1451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 16:34:06.451849 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-db56bb3f-4484-471a-b122-8e90b2024dfe tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Calling method '>' {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:34:06.462178 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-db56bb3f-4484-471a-b122-8e90b2024dfe tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] [instance: 30b3ffec-7110-4b4d-9482-2451914c166f] Fetching instance by UUID {{(pid=102149) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:34:06.516690 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-db56bb3f-4484-471a-b122-8e90b2024dfe tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:34:06.529506 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-a72ad2dc-ee28-4208-9d87-3f3dbc9f8ca4 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c286a3f03048689e5ec552bb89c161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09584de3a4b14c5a90eb9b1c2149d6fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:34:06.534258 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-db56bb3f-4484-471a-b122-8e90b2024dfe tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:34:06.540137 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-db56bb3f-4484-471a-b122-8e90b2024dfe tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:34:06.540593 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-db56bb3f-4484-471a-b122-8e90b2024dfe tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:34:06.561911 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-a72ad2dc-ee28-4208-9d87-3f3dbc9f8ca4 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] 10.222.0.18 "GET /compute/v2.1/servers/1739cd84-3709-4cf4-95e3-82de4b4d3d7a" status: 200 len: 1369 microversion: 2.1 time: 2.403783 Jun 24 16:34:06.580356 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 132/243] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:34:04 2022] GET /compute/v2.1/servers/1739cd84-3709-4cf4-95e3-82de4b4d3d7a => generated 1369 bytes in 2424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 16:34:07.024641 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [req-f36df843-dea8-4a67-8d92-e0c5a673e7de req-05680329-dab6-409f-87bb-4de173f88588 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1739cd84-3709-4cf4-95e3-82de4b4d3d7a", "tag": "8a215961-1299-415e-b991-1271a78f7ae0"}]} {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 16:34:07.055589 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 24 16:34:07.055589 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: warnings.warn(msg) Jun 24 16:34:07.078475 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [req-f36df843-dea8-4a67-8d92-e0c5a673e7de req-05680329-dab6-409f-87bb-4de173f88588 service nova] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:34:07.078951 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [req-f36df843-dea8-4a67-8d92-e0c5a673e7de req-05680329-dab6-409f-87bb-4de173f88588 service nova] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:34:07.105620 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.compute.server_external_events [req-f36df843-dea8-4a67-8d92-e0c5a673e7de req-05680329-dab6-409f-87bb-4de173f88588 service nova] Creating event network-changed:8a215961-1299-415e-b991-1271a78f7ae0 for instance 1739cd84-3709-4cf4-95e3-82de4b4d3d7a on hv-cinder-84718 Jun 24 16:34:07.123579 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [req-f36df843-dea8-4a67-8d92-e0c5a673e7de req-05680329-dab6-409f-87bb-4de173f88588 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.103686 Jun 24 16:34:07.127684 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 133/244] 10.222.0.18 () {64 vars in 1317 bytes} [Fri Jun 24 16:34:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 16:34:07.159385 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [req-e37509f7-aedc-41b9-af20-97e88ad0f9ad req-ae8a87b5-e64a-4d1d-95cd-c235e6094e07 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "30b3ffec-7110-4b4d-9482-2451914c166f", "name": "network-vif-plugged", "status": "completed", "tag": "78a4e31b-a598-4436-bdeb-0904cefd7b6e"}]} {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 16:34:07.161297 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 24 16:34:07.161297 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: warnings.warn(msg) Jun 24 16:34:07.193509 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [req-e37509f7-aedc-41b9-af20-97e88ad0f9ad req-ae8a87b5-e64a-4d1d-95cd-c235e6094e07 service nova] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:34:07.195738 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [req-e37509f7-aedc-41b9-af20-97e88ad0f9ad req-ae8a87b5-e64a-4d1d-95cd-c235e6094e07 service nova] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:34:07.260568 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.compute.server_external_events [req-e37509f7-aedc-41b9-af20-97e88ad0f9ad req-ae8a87b5-e64a-4d1d-95cd-c235e6094e07 service nova] Creating event network-vif-plugged:78a4e31b-a598-4436-bdeb-0904cefd7b6e for instance 30b3ffec-7110-4b4d-9482-2451914c166f on hv-cinder-84718 Jun 24 16:34:07.276840 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [req-e37509f7-aedc-41b9-af20-97e88ad0f9ad req-ae8a87b5-e64a-4d1d-95cd-c235e6094e07 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.123462 Jun 24 16:34:07.278966 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 134/245] 10.222.0.18 () {64 vars in 1317 bytes} [Fri Jun 24 16:34:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 16:34:07.472659 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-ebd672b8-4353-44e9-a234-1168b3cda8fc tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Calling method '>' {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:34:07.474208 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-ebd672b8-4353-44e9-a234-1168b3cda8fc tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] [instance: 24dce890-4ccc-4122-8b62-438ea395fb9a] Fetching instance by UUID {{(pid=102148) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:34:07.488090 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-ebd672b8-4353-44e9-a234-1168b3cda8fc tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:34:07.488898 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-ebd672b8-4353-44e9-a234-1168b3cda8fc tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:34:07.499815 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-ebd672b8-4353-44e9-a234-1168b3cda8fc tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:34:07.500731 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-ebd672b8-4353-44e9-a234-1168b3cda8fc tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:34:07.527758 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-db56bb3f-4484-471a-b122-8e90b2024dfe tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7489b29cb3ef47d78dfd55794f338b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065254ebe67545639644fcbc6bd9fc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:34:07.541512 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-db56bb3f-4484-471a-b122-8e90b2024dfe tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7489b29cb3ef47d78dfd55794f338b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065254ebe67545639644fcbc6bd9fc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:34:07.543483 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-db56bb3f-4484-471a-b122-8e90b2024dfe tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7489b29cb3ef47d78dfd55794f338b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065254ebe67545639644fcbc6bd9fc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:34:07.545656 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-db56bb3f-4484-471a-b122-8e90b2024dfe tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] 10.222.0.18 "GET /compute/v2.1/servers/30b3ffec-7110-4b4d-9482-2451914c166f" status: 200 len: 1738 microversion: 2.20 time: 1.111479 Jun 24 16:34:07.559213 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 112/246] 10.222.0.18 () {60 vars in 1276 bytes} [Fri Jun 24 16:34:06 2022] GET /compute/v2.1/servers/30b3ffec-7110-4b4d-9482-2451914c166f => generated 1738 bytes in 1126 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 16:34:07.601534 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-f45b1669-c580-4df3-aa75-0f7a3f20582a tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Calling method '>' {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:34:07.602181 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-f45b1669-c580-4df3-aa75-0f7a3f20582a tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] [instance: 1739cd84-3709-4cf4-95e3-82de4b4d3d7a] Fetching instance by UUID {{(pid=102149) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:34:07.637770 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-f45b1669-c580-4df3-aa75-0f7a3f20582a tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:34:07.639340 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-f45b1669-c580-4df3-aa75-0f7a3f20582a tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:34:07.640400 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-f45b1669-c580-4df3-aa75-0f7a3f20582a tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:34:07.641029 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-f45b1669-c580-4df3-aa75-0f7a3f20582a tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:34:07.909285 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-ebd672b8-4353-44e9-a234-1168b3cda8fc tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '499faf87cf8c41ae823b2566e4c2d8ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606ba814a2d8408ab0856d539ca79b4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:34:07.942630 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-ebd672b8-4353-44e9-a234-1168b3cda8fc tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] 10.222.0.18 "GET /compute/v2.1/servers/24dce890-4ccc-4122-8b62-438ea395fb9a" status: 200 len: 1299 microversion: 2.1 time: 0.475512 Jun 24 16:34:07.944137 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 135/247] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:34:07 2022] GET /compute/v2.1/servers/24dce890-4ccc-4122-8b62-438ea395fb9a => generated 1299 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 16:34:08.102667 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-f45b1669-c580-4df3-aa75-0f7a3f20582a tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c286a3f03048689e5ec552bb89c161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09584de3a4b14c5a90eb9b1c2149d6fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:34:08.162221 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-f45b1669-c580-4df3-aa75-0f7a3f20582a tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] 10.222.0.18 "GET /compute/v2.1/servers/1739cd84-3709-4cf4-95e3-82de4b4d3d7a" status: 200 len: 1369 microversion: 2.1 time: 0.567544 Jun 24 16:34:08.173763 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 113/248] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:34:07 2022] GET /compute/v2.1/servers/1739cd84-3709-4cf4-95e3-82de4b4d3d7a => generated 1369 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 16:34:08.569081 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-7d8ab58f-e2e2-427c-82ad-42f2c70aeb10 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Calling method '>' {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:34:08.570047 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-7d8ab58f-e2e2-427c-82ad-42f2c70aeb10 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] [instance: 30b3ffec-7110-4b4d-9482-2451914c166f] Fetching instance by UUID {{(pid=102148) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:34:08.585579 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-7d8ab58f-e2e2-427c-82ad-42f2c70aeb10 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:34:08.586023 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-7d8ab58f-e2e2-427c-82ad-42f2c70aeb10 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:34:08.586932 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-7d8ab58f-e2e2-427c-82ad-42f2c70aeb10 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:34:08.587461 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-7d8ab58f-e2e2-427c-82ad-42f2c70aeb10 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:34:08.963574 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-66fecbbf-5aeb-4e20-8cf0-c7b5ec9aded6 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Calling method '>' {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:34:08.965817 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-66fecbbf-5aeb-4e20-8cf0-c7b5ec9aded6 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] [instance: 24dce890-4ccc-4122-8b62-438ea395fb9a] Fetching instance by UUID {{(pid=102149) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:34:08.976973 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-7d8ab58f-e2e2-427c-82ad-42f2c70aeb10 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7489b29cb3ef47d78dfd55794f338b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065254ebe67545639644fcbc6bd9fc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:34:08.991562 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-7d8ab58f-e2e2-427c-82ad-42f2c70aeb10 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7489b29cb3ef47d78dfd55794f338b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065254ebe67545639644fcbc6bd9fc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:34:08.993095 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-7d8ab58f-e2e2-427c-82ad-42f2c70aeb10 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7489b29cb3ef47d78dfd55794f338b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065254ebe67545639644fcbc6bd9fc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:34:08.994301 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-66fecbbf-5aeb-4e20-8cf0-c7b5ec9aded6 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:34:08.994668 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-7d8ab58f-e2e2-427c-82ad-42f2c70aeb10 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] 10.222.0.18 "GET /compute/v2.1/servers/30b3ffec-7110-4b4d-9482-2451914c166f" status: 200 len: 1738 microversion: 2.20 time: 0.430948 Jun 24 16:34:08.995779 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 136/249] 10.222.0.18 () {60 vars in 1276 bytes} [Fri Jun 24 16:34:08 2022] GET /compute/v2.1/servers/30b3ffec-7110-4b4d-9482-2451914c166f => generated 1738 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 16:34:08.996492 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-66fecbbf-5aeb-4e20-8cf0-c7b5ec9aded6 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:34:09.000549 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-66fecbbf-5aeb-4e20-8cf0-c7b5ec9aded6 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:34:09.006664 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-66fecbbf-5aeb-4e20-8cf0-c7b5ec9aded6 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:34:09.182272 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-0dcf8284-cba5-4a89-924f-f8225893e5ec tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Calling method '>' {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:34:09.185528 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-0dcf8284-cba5-4a89-924f-f8225893e5ec tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] [instance: 1739cd84-3709-4cf4-95e3-82de4b4d3d7a] Fetching instance by UUID {{(pid=102148) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:34:09.221670 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-0dcf8284-cba5-4a89-924f-f8225893e5ec tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:34:09.225019 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-0dcf8284-cba5-4a89-924f-f8225893e5ec tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:34:09.226585 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-0dcf8284-cba5-4a89-924f-f8225893e5ec tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:34:09.240023 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-0dcf8284-cba5-4a89-924f-f8225893e5ec tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:34:10.428131 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-66fecbbf-5aeb-4e20-8cf0-c7b5ec9aded6 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '499faf87cf8c41ae823b2566e4c2d8ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606ba814a2d8408ab0856d539ca79b4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:34:10.441844 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-66fecbbf-5aeb-4e20-8cf0-c7b5ec9aded6 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] 10.222.0.18 "GET /compute/v2.1/servers/24dce890-4ccc-4122-8b62-438ea395fb9a" status: 200 len: 1366 microversion: 2.1 time: 1.484219 Jun 24 16:34:10.459308 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 114/250] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:34:08 2022] GET /compute/v2.1/servers/24dce890-4ccc-4122-8b62-438ea395fb9a => generated 1366 bytes in 1502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 16:34:10.471209 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-bf3be724-d931-403c-a118-f6b3752ef26b tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Calling method '>' {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:34:10.483368 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-bf3be724-d931-403c-a118-f6b3752ef26b tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] [instance: 30b3ffec-7110-4b4d-9482-2451914c166f] Fetching instance by UUID {{(pid=102149) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:34:10.506145 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-bf3be724-d931-403c-a118-f6b3752ef26b tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:34:10.506992 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-bf3be724-d931-403c-a118-f6b3752ef26b tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:34:10.510363 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-bf3be724-d931-403c-a118-f6b3752ef26b tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:34:10.510972 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-bf3be724-d931-403c-a118-f6b3752ef26b tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:34:10.698179 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-0dcf8284-cba5-4a89-924f-f8225893e5ec tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c286a3f03048689e5ec552bb89c161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09584de3a4b14c5a90eb9b1c2149d6fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:34:10.714428 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-0dcf8284-cba5-4a89-924f-f8225893e5ec tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] 10.222.0.18 "GET /compute/v2.1/servers/1739cd84-3709-4cf4-95e3-82de4b4d3d7a" status: 200 len: 1369 microversion: 2.1 time: 1.537045 Jun 24 16:34:10.720084 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 137/251] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:34:09 2022] GET /compute/v2.1/servers/1739cd84-3709-4cf4-95e3-82de4b4d3d7a => generated 1369 bytes in 1544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 16:34:11.465836 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-08afb6d2-035c-4697-85a8-08e58b82efaf tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Calling method '>' {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:34:11.467647 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-08afb6d2-035c-4697-85a8-08e58b82efaf tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] [instance: 24dce890-4ccc-4122-8b62-438ea395fb9a] Fetching instance by UUID {{(pid=102148) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:34:11.489469 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-08afb6d2-035c-4697-85a8-08e58b82efaf tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:34:11.496368 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-08afb6d2-035c-4697-85a8-08e58b82efaf tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:34:11.507934 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-08afb6d2-035c-4697-85a8-08e58b82efaf tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:34:11.509202 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-08afb6d2-035c-4697-85a8-08e58b82efaf tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:34:12.110657 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-bf3be724-d931-403c-a118-f6b3752ef26b tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7489b29cb3ef47d78dfd55794f338b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065254ebe67545639644fcbc6bd9fc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:34:12.157809 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-bf3be724-d931-403c-a118-f6b3752ef26b tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7489b29cb3ef47d78dfd55794f338b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065254ebe67545639644fcbc6bd9fc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:34:12.171056 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-bf3be724-d931-403c-a118-f6b3752ef26b tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7489b29cb3ef47d78dfd55794f338b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065254ebe67545639644fcbc6bd9fc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:34:12.173763 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-bf3be724-d931-403c-a118-f6b3752ef26b tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] 10.222.0.18 "GET /compute/v2.1/servers/30b3ffec-7110-4b4d-9482-2451914c166f" status: 200 len: 1738 microversion: 2.20 time: 1.712130 Jun 24 16:34:12.178467 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 115/252] 10.222.0.18 () {60 vars in 1276 bytes} [Fri Jun 24 16:34:10 2022] GET /compute/v2.1/servers/30b3ffec-7110-4b4d-9482-2451914c166f => generated 1738 bytes in 1718 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 16:34:12.188612 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-a2ebd2d6-9c26-4d7f-bcb1-882550a3a6a7 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Calling method '>' {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:34:12.209386 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-a2ebd2d6-9c26-4d7f-bcb1-882550a3a6a7 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] [instance: 1739cd84-3709-4cf4-95e3-82de4b4d3d7a] Fetching instance by UUID {{(pid=102149) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:34:12.273362 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-a2ebd2d6-9c26-4d7f-bcb1-882550a3a6a7 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:34:12.280132 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-a2ebd2d6-9c26-4d7f-bcb1-882550a3a6a7 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:34:12.283387 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-a2ebd2d6-9c26-4d7f-bcb1-882550a3a6a7 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:34:12.287245 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-a2ebd2d6-9c26-4d7f-bcb1-882550a3a6a7 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:34:13.392857 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-08afb6d2-035c-4697-85a8-08e58b82efaf tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '499faf87cf8c41ae823b2566e4c2d8ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606ba814a2d8408ab0856d539ca79b4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:34:13.413520 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-08afb6d2-035c-4697-85a8-08e58b82efaf tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] 10.222.0.18 "GET /compute/v2.1/servers/24dce890-4ccc-4122-8b62-438ea395fb9a" status: 200 len: 1366 microversion: 2.1 time: 1.946696 Jun 24 16:34:13.418294 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 138/253] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:34:11 2022] GET /compute/v2.1/servers/24dce890-4ccc-4122-8b62-438ea395fb9a => generated 1366 bytes in 1958 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 16:34:13.424737 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-70ff496e-518d-480d-8797-3ab252e6a7ea tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Calling method '>' {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:34:13.425381 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-70ff496e-518d-480d-8797-3ab252e6a7ea tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] [instance: 30b3ffec-7110-4b4d-9482-2451914c166f] Fetching instance by UUID {{(pid=102148) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:34:13.434989 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-70ff496e-518d-480d-8797-3ab252e6a7ea tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:34:13.436315 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-70ff496e-518d-480d-8797-3ab252e6a7ea tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:34:13.437399 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-70ff496e-518d-480d-8797-3ab252e6a7ea tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:34:13.438920 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-70ff496e-518d-480d-8797-3ab252e6a7ea tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:34:13.981173 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-a2ebd2d6-9c26-4d7f-bcb1-882550a3a6a7 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c286a3f03048689e5ec552bb89c161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09584de3a4b14c5a90eb9b1c2149d6fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:34:14.004659 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-a2ebd2d6-9c26-4d7f-bcb1-882550a3a6a7 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] 10.222.0.18 "GET /compute/v2.1/servers/1739cd84-3709-4cf4-95e3-82de4b4d3d7a" status: 200 len: 1369 microversion: 2.1 time: 1.822605 Jun 24 16:34:14.006031 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 116/254] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:34:12 2022] GET /compute/v2.1/servers/1739cd84-3709-4cf4-95e3-82de4b4d3d7a => generated 1369 bytes in 1827 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 16:34:14.439122 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-abdb7812-5edc-46a3-a5f0-9930def60e85 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Calling method '>' {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:34:14.439122 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-abdb7812-5edc-46a3-a5f0-9930def60e85 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] [instance: 24dce890-4ccc-4122-8b62-438ea395fb9a] Fetching instance by UUID {{(pid=102149) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:34:14.495009 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-abdb7812-5edc-46a3-a5f0-9930def60e85 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:34:14.501177 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-abdb7812-5edc-46a3-a5f0-9930def60e85 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:34:14.506655 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-abdb7812-5edc-46a3-a5f0-9930def60e85 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:34:14.514130 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-abdb7812-5edc-46a3-a5f0-9930def60e85 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:34:14.744261 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-70ff496e-518d-480d-8797-3ab252e6a7ea tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7489b29cb3ef47d78dfd55794f338b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065254ebe67545639644fcbc6bd9fc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:34:14.783431 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-70ff496e-518d-480d-8797-3ab252e6a7ea tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7489b29cb3ef47d78dfd55794f338b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065254ebe67545639644fcbc6bd9fc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:34:14.785773 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-70ff496e-518d-480d-8797-3ab252e6a7ea tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7489b29cb3ef47d78dfd55794f338b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065254ebe67545639644fcbc6bd9fc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:34:14.787282 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-70ff496e-518d-480d-8797-3ab252e6a7ea tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] 10.222.0.18 "GET /compute/v2.1/servers/30b3ffec-7110-4b4d-9482-2451914c166f" status: 200 len: 1738 microversion: 2.20 time: 1.367886 Jun 24 16:34:14.788197 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 139/255] 10.222.0.18 () {60 vars in 1276 bytes} [Fri Jun 24 16:34:13 2022] GET /compute/v2.1/servers/30b3ffec-7110-4b4d-9482-2451914c166f => generated 1738 bytes in 1369 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 16:34:14.806540 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [req-f7862cb4-ae9e-48f0-b4e0-a02ebc84ef4d req-5df3b21f-2349-444a-bd3e-e8522d6417bc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "24dce890-4ccc-4122-8b62-438ea395fb9a", "tag": "da1e5556-b87a-41c9-8727-30b8a9ea8c11"}]} {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 16:34:14.812631 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 24 16:34:14.812631 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: warnings.warn(msg) Jun 24 16:34:14.838600 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [req-f7862cb4-ae9e-48f0-b4e0-a02ebc84ef4d req-5df3b21f-2349-444a-bd3e-e8522d6417bc service nova] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:34:14.846235 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [req-f7862cb4-ae9e-48f0-b4e0-a02ebc84ef4d req-5df3b21f-2349-444a-bd3e-e8522d6417bc service nova] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:34:14.954344 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.compute.server_external_events [req-f7862cb4-ae9e-48f0-b4e0-a02ebc84ef4d req-5df3b21f-2349-444a-bd3e-e8522d6417bc service nova] Creating event network-changed:da1e5556-b87a-41c9-8727-30b8a9ea8c11 for instance 24dce890-4ccc-4122-8b62-438ea395fb9a on hv-cinder-84718 Jun 24 16:34:14.978497 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [req-f7862cb4-ae9e-48f0-b4e0-a02ebc84ef4d req-5df3b21f-2349-444a-bd3e-e8522d6417bc service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.186227 Jun 24 16:34:14.985292 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 140/256] 10.222.0.18 () {64 vars in 1317 bytes} [Fri Jun 24 16:34:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 16:34:15.030602 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-4b1295ed-2cc9-4e0f-a9f7-a2473310fa4f tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Calling method '>' {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:34:15.032559 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-4b1295ed-2cc9-4e0f-a9f7-a2473310fa4f tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] [instance: 1739cd84-3709-4cf4-95e3-82de4b4d3d7a] Fetching instance by UUID {{(pid=102148) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:34:15.058862 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-4b1295ed-2cc9-4e0f-a9f7-a2473310fa4f tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:34:15.064299 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-4b1295ed-2cc9-4e0f-a9f7-a2473310fa4f tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:34:15.065440 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-4b1295ed-2cc9-4e0f-a9f7-a2473310fa4f tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:34:15.067771 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-4b1295ed-2cc9-4e0f-a9f7-a2473310fa4f tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:34:16.998755 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-abdb7812-5edc-46a3-a5f0-9930def60e85 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '499faf87cf8c41ae823b2566e4c2d8ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606ba814a2d8408ab0856d539ca79b4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:34:17.035979 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-abdb7812-5edc-46a3-a5f0-9930def60e85 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] 10.222.0.18 "GET /compute/v2.1/servers/24dce890-4ccc-4122-8b62-438ea395fb9a" status: 200 len: 1366 microversion: 2.1 time: 2.613071 Jun 24 16:34:17.037035 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 117/257] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:34:14 2022] GET /compute/v2.1/servers/24dce890-4ccc-4122-8b62-438ea395fb9a => generated 1366 bytes in 2616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 16:34:17.078787 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-c9bef8c6-d4d4-4fc5-95f7-3d8400cc9f31 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Calling method '>' {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:34:17.092502 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-c9bef8c6-d4d4-4fc5-95f7-3d8400cc9f31 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] [instance: 30b3ffec-7110-4b4d-9482-2451914c166f] Fetching instance by UUID {{(pid=102149) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:34:17.133849 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-c9bef8c6-d4d4-4fc5-95f7-3d8400cc9f31 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:34:17.143925 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-c9bef8c6-d4d4-4fc5-95f7-3d8400cc9f31 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:34:17.145730 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-c9bef8c6-d4d4-4fc5-95f7-3d8400cc9f31 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:34:17.146743 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-c9bef8c6-d4d4-4fc5-95f7-3d8400cc9f31 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:34:17.493102 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-4b1295ed-2cc9-4e0f-a9f7-a2473310fa4f tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c286a3f03048689e5ec552bb89c161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09584de3a4b14c5a90eb9b1c2149d6fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:34:17.582158 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-4b1295ed-2cc9-4e0f-a9f7-a2473310fa4f tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] 10.222.0.18 "GET /compute/v2.1/servers/1739cd84-3709-4cf4-95e3-82de4b4d3d7a" status: 200 len: 1369 microversion: 2.1 time: 2.550103 Jun 24 16:34:17.618724 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 141/258] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:34:15 2022] GET /compute/v2.1/servers/1739cd84-3709-4cf4-95e3-82de4b4d3d7a => generated 1369 bytes in 2582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 16:34:18.069042 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-92f65bf4-ef75-4c36-bfa8-cc1bd746712e tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Calling method '>' {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:34:18.070578 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-92f65bf4-ef75-4c36-bfa8-cc1bd746712e tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] [instance: 24dce890-4ccc-4122-8b62-438ea395fb9a] Fetching instance by UUID {{(pid=102148) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:34:18.104206 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-92f65bf4-ef75-4c36-bfa8-cc1bd746712e tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:34:18.105469 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-92f65bf4-ef75-4c36-bfa8-cc1bd746712e tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:34:18.112510 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-92f65bf4-ef75-4c36-bfa8-cc1bd746712e tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:34:18.119395 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-92f65bf4-ef75-4c36-bfa8-cc1bd746712e tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:34:18.788327 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-c9bef8c6-d4d4-4fc5-95f7-3d8400cc9f31 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7489b29cb3ef47d78dfd55794f338b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065254ebe67545639644fcbc6bd9fc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:34:18.805877 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-c9bef8c6-d4d4-4fc5-95f7-3d8400cc9f31 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7489b29cb3ef47d78dfd55794f338b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065254ebe67545639644fcbc6bd9fc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:34:18.807759 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-c9bef8c6-d4d4-4fc5-95f7-3d8400cc9f31 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7489b29cb3ef47d78dfd55794f338b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065254ebe67545639644fcbc6bd9fc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:34:18.809141 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-c9bef8c6-d4d4-4fc5-95f7-3d8400cc9f31 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] 10.222.0.18 "GET /compute/v2.1/servers/30b3ffec-7110-4b4d-9482-2451914c166f" status: 200 len: 1738 microversion: 2.20 time: 1.755044 Jun 24 16:34:18.813019 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 118/259] 10.222.0.18 () {60 vars in 1276 bytes} [Fri Jun 24 16:34:17 2022] GET /compute/v2.1/servers/30b3ffec-7110-4b4d-9482-2451914c166f => generated 1738 bytes in 1760 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 16:34:18.819604 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-cc3d300c-17ed-42ce-a66c-4cdc8ab962c1 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Calling method '>' {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:34:18.821302 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-cc3d300c-17ed-42ce-a66c-4cdc8ab962c1 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] [instance: 1739cd84-3709-4cf4-95e3-82de4b4d3d7a] Fetching instance by UUID {{(pid=102149) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:34:18.857633 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-cc3d300c-17ed-42ce-a66c-4cdc8ab962c1 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:34:18.858642 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-cc3d300c-17ed-42ce-a66c-4cdc8ab962c1 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:34:18.859719 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-cc3d300c-17ed-42ce-a66c-4cdc8ab962c1 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:34:18.860375 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-cc3d300c-17ed-42ce-a66c-4cdc8ab962c1 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:34:19.455450 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-92f65bf4-ef75-4c36-bfa8-cc1bd746712e tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '499faf87cf8c41ae823b2566e4c2d8ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606ba814a2d8408ab0856d539ca79b4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:34:19.480999 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-92f65bf4-ef75-4c36-bfa8-cc1bd746712e tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] 10.222.0.18 "GET /compute/v2.1/servers/24dce890-4ccc-4122-8b62-438ea395fb9a" status: 200 len: 1366 microversion: 2.1 time: 1.418378 Jun 24 16:34:19.493267 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 142/260] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:34:18 2022] GET /compute/v2.1/servers/24dce890-4ccc-4122-8b62-438ea395fb9a => generated 1366 bytes in 1432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 16:34:19.840562 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-cc3d300c-17ed-42ce-a66c-4cdc8ab962c1 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c286a3f03048689e5ec552bb89c161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09584de3a4b14c5a90eb9b1c2149d6fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:34:19.843806 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-93d9fcc1-9eff-4526-9d83-19aec1dee696 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Calling method '>' {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:34:19.844976 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-93d9fcc1-9eff-4526-9d83-19aec1dee696 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] [instance: 30b3ffec-7110-4b4d-9482-2451914c166f] Fetching instance by UUID {{(pid=102148) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:34:19.850227 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-cc3d300c-17ed-42ce-a66c-4cdc8ab962c1 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] 10.222.0.18 "GET /compute/v2.1/servers/1739cd84-3709-4cf4-95e3-82de4b4d3d7a" status: 200 len: 1369 microversion: 2.1 time: 1.035651 Jun 24 16:34:19.860359 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 119/261] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:34:18 2022] GET /compute/v2.1/servers/1739cd84-3709-4cf4-95e3-82de4b4d3d7a => generated 1369 bytes in 1046 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 16:34:19.865895 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-93d9fcc1-9eff-4526-9d83-19aec1dee696 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:34:19.870482 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-93d9fcc1-9eff-4526-9d83-19aec1dee696 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:34:19.872091 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-93d9fcc1-9eff-4526-9d83-19aec1dee696 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:34:19.873082 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-93d9fcc1-9eff-4526-9d83-19aec1dee696 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:34:20.511484 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-49d6fd5e-4280-4bfc-b628-cc5f076c38be tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Calling method '>' {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:34:20.512832 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-49d6fd5e-4280-4bfc-b628-cc5f076c38be tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] [instance: 24dce890-4ccc-4122-8b62-438ea395fb9a] Fetching instance by UUID {{(pid=102149) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:34:20.550405 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-49d6fd5e-4280-4bfc-b628-cc5f076c38be tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:34:20.559051 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-49d6fd5e-4280-4bfc-b628-cc5f076c38be tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:34:20.567238 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-49d6fd5e-4280-4bfc-b628-cc5f076c38be tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:34:20.569615 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-49d6fd5e-4280-4bfc-b628-cc5f076c38be tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:34:20.829775 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-93d9fcc1-9eff-4526-9d83-19aec1dee696 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7489b29cb3ef47d78dfd55794f338b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065254ebe67545639644fcbc6bd9fc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:34:20.844444 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-93d9fcc1-9eff-4526-9d83-19aec1dee696 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7489b29cb3ef47d78dfd55794f338b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065254ebe67545639644fcbc6bd9fc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:34:20.857278 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-93d9fcc1-9eff-4526-9d83-19aec1dee696 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7489b29cb3ef47d78dfd55794f338b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065254ebe67545639644fcbc6bd9fc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:34:20.858810 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-93d9fcc1-9eff-4526-9d83-19aec1dee696 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] 10.222.0.18 "GET /compute/v2.1/servers/30b3ffec-7110-4b4d-9482-2451914c166f" status: 200 len: 1738 microversion: 2.20 time: 1.021792 Jun 24 16:34:20.859905 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 143/262] 10.222.0.18 () {60 vars in 1276 bytes} [Fri Jun 24 16:34:19 2022] GET /compute/v2.1/servers/30b3ffec-7110-4b4d-9482-2451914c166f => generated 1738 bytes in 1024 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 16:34:20.879243 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-1121ae5f-4b98-433d-884b-a1b8dfb5223c tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Calling method '>' {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:34:20.880259 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-1121ae5f-4b98-433d-884b-a1b8dfb5223c tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] [instance: 1739cd84-3709-4cf4-95e3-82de4b4d3d7a] Fetching instance by UUID {{(pid=102148) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:34:20.899335 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-1121ae5f-4b98-433d-884b-a1b8dfb5223c tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:34:20.900252 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-1121ae5f-4b98-433d-884b-a1b8dfb5223c tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:34:20.901330 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-1121ae5f-4b98-433d-884b-a1b8dfb5223c tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:34:20.902014 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-1121ae5f-4b98-433d-884b-a1b8dfb5223c tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:34:21.728757 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-49d6fd5e-4280-4bfc-b628-cc5f076c38be tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '499faf87cf8c41ae823b2566e4c2d8ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606ba814a2d8408ab0856d539ca79b4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:34:21.811691 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-49d6fd5e-4280-4bfc-b628-cc5f076c38be tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] 10.222.0.18 "GET /compute/v2.1/servers/24dce890-4ccc-4122-8b62-438ea395fb9a" status: 200 len: 1366 microversion: 2.1 time: 1.293753 Jun 24 16:34:21.819570 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 120/263] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:34:20 2022] GET /compute/v2.1/servers/24dce890-4ccc-4122-8b62-438ea395fb9a => generated 1366 bytes in 1315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 16:34:21.891043 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-b37251b7-ce70-4b6d-92cd-d07e89028674 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Calling method '>' {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:34:21.892455 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-b37251b7-ce70-4b6d-92cd-d07e89028674 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] [instance: 30b3ffec-7110-4b4d-9482-2451914c166f] Fetching instance by UUID {{(pid=102149) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:34:21.914425 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-b37251b7-ce70-4b6d-92cd-d07e89028674 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:34:21.915458 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-b37251b7-ce70-4b6d-92cd-d07e89028674 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:34:21.917041 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-b37251b7-ce70-4b6d-92cd-d07e89028674 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:34:21.934043 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-b37251b7-ce70-4b6d-92cd-d07e89028674 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:34:22.024752 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-1121ae5f-4b98-433d-884b-a1b8dfb5223c tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c286a3f03048689e5ec552bb89c161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09584de3a4b14c5a90eb9b1c2149d6fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:34:22.037604 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-1121ae5f-4b98-433d-884b-a1b8dfb5223c tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] 10.222.0.18 "GET /compute/v2.1/servers/1739cd84-3709-4cf4-95e3-82de4b4d3d7a" status: 200 len: 1369 microversion: 2.1 time: 1.158803 Jun 24 16:34:22.047809 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 144/264] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:34:20 2022] GET /compute/v2.1/servers/1739cd84-3709-4cf4-95e3-82de4b4d3d7a => generated 1369 bytes in 1173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 16:34:22.845262 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-f2bdf2a0-ae27-46aa-9c26-5c46563f101e tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Calling method '>' {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:34:22.861332 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-f2bdf2a0-ae27-46aa-9c26-5c46563f101e tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] [instance: 24dce890-4ccc-4122-8b62-438ea395fb9a] Fetching instance by UUID {{(pid=102148) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:34:22.950041 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-f2bdf2a0-ae27-46aa-9c26-5c46563f101e tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:34:22.958712 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-f2bdf2a0-ae27-46aa-9c26-5c46563f101e tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:34:22.965113 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-f2bdf2a0-ae27-46aa-9c26-5c46563f101e tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:34:22.967349 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-f2bdf2a0-ae27-46aa-9c26-5c46563f101e tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:34:23.069664 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-b37251b7-ce70-4b6d-92cd-d07e89028674 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7489b29cb3ef47d78dfd55794f338b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065254ebe67545639644fcbc6bd9fc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:34:23.106460 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-b37251b7-ce70-4b6d-92cd-d07e89028674 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7489b29cb3ef47d78dfd55794f338b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065254ebe67545639644fcbc6bd9fc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:34:23.113575 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-b37251b7-ce70-4b6d-92cd-d07e89028674 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7489b29cb3ef47d78dfd55794f338b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065254ebe67545639644fcbc6bd9fc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:34:23.115254 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-b37251b7-ce70-4b6d-92cd-d07e89028674 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] 10.222.0.18 "GET /compute/v2.1/servers/30b3ffec-7110-4b4d-9482-2451914c166f" status: 200 len: 1738 microversion: 2.20 time: 1.228869 Jun 24 16:34:23.120123 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 121/265] 10.222.0.18 () {60 vars in 1276 bytes} [Fri Jun 24 16:34:21 2022] GET /compute/v2.1/servers/30b3ffec-7110-4b4d-9482-2451914c166f => generated 1738 bytes in 1234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 16:34:23.128434 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-401c0291-6f9c-4cfd-a80a-70d3b67877d3 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Calling method '>' {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:34:23.135709 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-401c0291-6f9c-4cfd-a80a-70d3b67877d3 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] [instance: 1739cd84-3709-4cf4-95e3-82de4b4d3d7a] Fetching instance by UUID {{(pid=102149) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:34:23.190447 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-401c0291-6f9c-4cfd-a80a-70d3b67877d3 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:34:23.191472 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-401c0291-6f9c-4cfd-a80a-70d3b67877d3 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:34:23.192501 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-401c0291-6f9c-4cfd-a80a-70d3b67877d3 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:34:23.199252 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-401c0291-6f9c-4cfd-a80a-70d3b67877d3 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:34:25.471565 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-401c0291-6f9c-4cfd-a80a-70d3b67877d3 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c286a3f03048689e5ec552bb89c161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09584de3a4b14c5a90eb9b1c2149d6fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:34:25.512167 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-401c0291-6f9c-4cfd-a80a-70d3b67877d3 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] 10.222.0.18 "GET /compute/v2.1/servers/1739cd84-3709-4cf4-95e3-82de4b4d3d7a" status: 200 len: 1369 microversion: 2.1 time: 2.389627 Jun 24 16:34:25.535197 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 122/266] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:34:23 2022] GET /compute/v2.1/servers/1739cd84-3709-4cf4-95e3-82de4b4d3d7a => generated 1369 bytes in 2414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 16:34:25.555834 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-7a7471b0-71d0-4aaa-ae4a-40c30c713fc0 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Calling method '>' {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:34:25.557576 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-7a7471b0-71d0-4aaa-ae4a-40c30c713fc0 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] [instance: 30b3ffec-7110-4b4d-9482-2451914c166f] Fetching instance by UUID {{(pid=102149) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:34:25.609496 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-7a7471b0-71d0-4aaa-ae4a-40c30c713fc0 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:34:25.610775 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-7a7471b0-71d0-4aaa-ae4a-40c30c713fc0 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:34:25.615572 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-7a7471b0-71d0-4aaa-ae4a-40c30c713fc0 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:34:25.622672 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-7a7471b0-71d0-4aaa-ae4a-40c30c713fc0 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:34:25.639199 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-f2bdf2a0-ae27-46aa-9c26-5c46563f101e tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '499faf87cf8c41ae823b2566e4c2d8ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606ba814a2d8408ab0856d539ca79b4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:34:25.673439 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-f2bdf2a0-ae27-46aa-9c26-5c46563f101e tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] 10.222.0.18 "GET /compute/v2.1/servers/24dce890-4ccc-4122-8b62-438ea395fb9a" status: 200 len: 1366 microversion: 2.1 time: 2.836390 Jun 24 16:34:25.718260 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 145/267] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:34:22 2022] GET /compute/v2.1/servers/24dce890-4ccc-4122-8b62-438ea395fb9a => generated 1366 bytes in 2882 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 16:34:25.740553 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [req-2cf7041d-a717-46b5-bc0c-416e9bf80c7a req-e77929f7-de4a-4a73-b4b7-a1c23e3dc477 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1739cd84-3709-4cf4-95e3-82de4b4d3d7a", "name": "network-vif-plugged", "status": "completed", "tag": "8a215961-1299-415e-b991-1271a78f7ae0"}]} {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 16:34:25.754016 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 24 16:34:25.754016 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: warnings.warn(msg) Jun 24 16:34:25.825285 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [req-2cf7041d-a717-46b5-bc0c-416e9bf80c7a req-e77929f7-de4a-4a73-b4b7-a1c23e3dc477 service nova] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:34:25.826504 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [req-2cf7041d-a717-46b5-bc0c-416e9bf80c7a req-e77929f7-de4a-4a73-b4b7-a1c23e3dc477 service nova] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:34:25.932802 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.compute.server_external_events [req-2cf7041d-a717-46b5-bc0c-416e9bf80c7a req-e77929f7-de4a-4a73-b4b7-a1c23e3dc477 service nova] Creating event network-vif-plugged:8a215961-1299-415e-b991-1271a78f7ae0 for instance 1739cd84-3709-4cf4-95e3-82de4b4d3d7a on hv-cinder-84718 Jun 24 16:34:25.953490 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [req-2cf7041d-a717-46b5-bc0c-416e9bf80c7a req-e77929f7-de4a-4a73-b4b7-a1c23e3dc477 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.232675 Jun 24 16:34:25.955068 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 146/268] 10.222.0.18 () {64 vars in 1317 bytes} [Fri Jun 24 16:34:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 16:34:26.458707 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-7a7471b0-71d0-4aaa-ae4a-40c30c713fc0 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7489b29cb3ef47d78dfd55794f338b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065254ebe67545639644fcbc6bd9fc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:34:26.470307 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-7a7471b0-71d0-4aaa-ae4a-40c30c713fc0 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7489b29cb3ef47d78dfd55794f338b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065254ebe67545639644fcbc6bd9fc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:34:26.473210 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-7a7471b0-71d0-4aaa-ae4a-40c30c713fc0 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7489b29cb3ef47d78dfd55794f338b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065254ebe67545639644fcbc6bd9fc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:34:26.476068 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-7a7471b0-71d0-4aaa-ae4a-40c30c713fc0 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] 10.222.0.18 "GET /compute/v2.1/servers/30b3ffec-7110-4b4d-9482-2451914c166f" status: 200 len: 1738 microversion: 2.20 time: 0.938904 Jun 24 16:34:26.480507 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 123/269] 10.222.0.18 () {60 vars in 1276 bytes} [Fri Jun 24 16:34:25 2022] GET /compute/v2.1/servers/30b3ffec-7110-4b4d-9482-2451914c166f => generated 1738 bytes in 943 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 16:34:26.545565 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-767a8ec1-fb6d-42b8-b077-7377390eb050 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Calling method '>' {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:34:26.551256 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-767a8ec1-fb6d-42b8-b077-7377390eb050 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] [instance: 1739cd84-3709-4cf4-95e3-82de4b4d3d7a] Fetching instance by UUID {{(pid=102148) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:34:26.594074 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-767a8ec1-fb6d-42b8-b077-7377390eb050 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:34:26.595131 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-767a8ec1-fb6d-42b8-b077-7377390eb050 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:34:26.596755 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-767a8ec1-fb6d-42b8-b077-7377390eb050 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:34:26.597822 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-767a8ec1-fb6d-42b8-b077-7377390eb050 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:34:26.732630 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-b32af955-3c0b-4cde-a1ef-4f39185b2825 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Calling method '>' {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:34:26.734099 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-b32af955-3c0b-4cde-a1ef-4f39185b2825 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] [instance: 24dce890-4ccc-4122-8b62-438ea395fb9a] Fetching instance by UUID {{(pid=102149) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:34:26.786808 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-b32af955-3c0b-4cde-a1ef-4f39185b2825 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:34:26.803935 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-b32af955-3c0b-4cde-a1ef-4f39185b2825 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:34:26.805520 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-b32af955-3c0b-4cde-a1ef-4f39185b2825 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:34:26.828143 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-b32af955-3c0b-4cde-a1ef-4f39185b2825 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:34:27.478540 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-767a8ec1-fb6d-42b8-b077-7377390eb050 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c286a3f03048689e5ec552bb89c161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09584de3a4b14c5a90eb9b1c2149d6fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:34:27.510737 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-767a8ec1-fb6d-42b8-b077-7377390eb050 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] 10.222.0.18 "GET /compute/v2.1/servers/1739cd84-3709-4cf4-95e3-82de4b4d3d7a" status: 200 len: 1369 microversion: 2.1 time: 0.972543 Jun 24 16:34:27.548084 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 147/270] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:34:26 2022] GET /compute/v2.1/servers/1739cd84-3709-4cf4-95e3-82de4b4d3d7a => generated 1369 bytes in 1011 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 16:34:27.570449 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-d5159312-11cd-40dd-87ad-cfb18da1a1a3 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Calling method '>' {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:34:27.588226 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-d5159312-11cd-40dd-87ad-cfb18da1a1a3 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] [instance: 30b3ffec-7110-4b4d-9482-2451914c166f] Fetching instance by UUID {{(pid=102148) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:34:27.636921 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-d5159312-11cd-40dd-87ad-cfb18da1a1a3 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:34:27.638268 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-d5159312-11cd-40dd-87ad-cfb18da1a1a3 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:34:27.645199 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-d5159312-11cd-40dd-87ad-cfb18da1a1a3 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:34:27.645997 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-d5159312-11cd-40dd-87ad-cfb18da1a1a3 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:34:27.706291 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-b32af955-3c0b-4cde-a1ef-4f39185b2825 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '499faf87cf8c41ae823b2566e4c2d8ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606ba814a2d8408ab0856d539ca79b4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:34:27.733316 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-b32af955-3c0b-4cde-a1ef-4f39185b2825 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] 10.222.0.18 "GET /compute/v2.1/servers/24dce890-4ccc-4122-8b62-438ea395fb9a" status: 200 len: 1366 microversion: 2.1 time: 1.010576 Jun 24 16:34:27.735914 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 124/271] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:34:26 2022] GET /compute/v2.1/servers/24dce890-4ccc-4122-8b62-438ea395fb9a => generated 1366 bytes in 1015 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 16:34:28.269294 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-d5159312-11cd-40dd-87ad-cfb18da1a1a3 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7489b29cb3ef47d78dfd55794f338b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065254ebe67545639644fcbc6bd9fc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:34:28.289219 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-d5159312-11cd-40dd-87ad-cfb18da1a1a3 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7489b29cb3ef47d78dfd55794f338b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065254ebe67545639644fcbc6bd9fc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:34:28.293114 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-d5159312-11cd-40dd-87ad-cfb18da1a1a3 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7489b29cb3ef47d78dfd55794f338b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065254ebe67545639644fcbc6bd9fc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:34:28.296579 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-d5159312-11cd-40dd-87ad-cfb18da1a1a3 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] 10.222.0.18 "GET /compute/v2.1/servers/30b3ffec-7110-4b4d-9482-2451914c166f" status: 200 len: 1738 microversion: 2.20 time: 0.746496 Jun 24 16:34:28.302666 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 148/272] 10.222.0.18 () {60 vars in 1276 bytes} [Fri Jun 24 16:34:27 2022] GET /compute/v2.1/servers/30b3ffec-7110-4b4d-9482-2451914c166f => generated 1738 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 16:34:28.577677 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-a6b2d0fb-de2f-4891-880f-6814b898d823 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Calling method '>' {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:34:28.578753 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-a6b2d0fb-de2f-4891-880f-6814b898d823 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] [instance: 1739cd84-3709-4cf4-95e3-82de4b4d3d7a] Fetching instance by UUID {{(pid=102149) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:34:28.634238 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-a6b2d0fb-de2f-4891-880f-6814b898d823 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:34:28.638258 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-a6b2d0fb-de2f-4891-880f-6814b898d823 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:34:28.639268 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-a6b2d0fb-de2f-4891-880f-6814b898d823 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:34:28.639769 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-a6b2d0fb-de2f-4891-880f-6814b898d823 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:34:28.762212 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-90abc4fc-7373-4ce3-9d5c-a5a4eba98f40 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Calling method '>' {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:34:28.763163 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-90abc4fc-7373-4ce3-9d5c-a5a4eba98f40 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] [instance: 24dce890-4ccc-4122-8b62-438ea395fb9a] Fetching instance by UUID {{(pid=102148) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:34:28.789371 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-90abc4fc-7373-4ce3-9d5c-a5a4eba98f40 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:34:28.789927 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-90abc4fc-7373-4ce3-9d5c-a5a4eba98f40 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:34:28.790821 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-90abc4fc-7373-4ce3-9d5c-a5a4eba98f40 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:34:28.791290 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-90abc4fc-7373-4ce3-9d5c-a5a4eba98f40 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:34:29.922756 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-a6b2d0fb-de2f-4891-880f-6814b898d823 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c286a3f03048689e5ec552bb89c161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09584de3a4b14c5a90eb9b1c2149d6fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:34:29.950084 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-a6b2d0fb-de2f-4891-880f-6814b898d823 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] 10.222.0.18 "GET /compute/v2.1/servers/1739cd84-3709-4cf4-95e3-82de4b4d3d7a" status: 200 len: 1564 microversion: 2.1 time: 1.387867 Jun 24 16:34:29.950676 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 125/273] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:34:28 2022] GET /compute/v2.1/servers/1739cd84-3709-4cf4-95e3-82de4b4d3d7a => generated 1564 bytes in 1390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 16:34:29.970951 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-61033e86-3e5e-4a7e-be82-fc88071f00c1 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Calling method '>' {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:34:29.971953 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-90abc4fc-7373-4ce3-9d5c-a5a4eba98f40 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '499faf87cf8c41ae823b2566e4c2d8ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606ba814a2d8408ab0856d539ca79b4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:34:29.972801 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-61033e86-3e5e-4a7e-be82-fc88071f00c1 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] [instance: 30b3ffec-7110-4b4d-9482-2451914c166f] Fetching instance by UUID {{(pid=102149) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:34:29.995969 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-90abc4fc-7373-4ce3-9d5c-a5a4eba98f40 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] 10.222.0.18 "GET /compute/v2.1/servers/24dce890-4ccc-4122-8b62-438ea395fb9a" status: 200 len: 1366 microversion: 2.1 time: 1.240537 Jun 24 16:34:29.998178 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 149/274] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:34:28 2022] GET /compute/v2.1/servers/24dce890-4ccc-4122-8b62-438ea395fb9a => generated 1366 bytes in 1244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 16:34:30.007507 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-61033e86-3e5e-4a7e-be82-fc88071f00c1 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:34:30.010531 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-61033e86-3e5e-4a7e-be82-fc88071f00c1 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:34:30.013617 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-61033e86-3e5e-4a7e-be82-fc88071f00c1 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:34:30.016333 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-61033e86-3e5e-4a7e-be82-fc88071f00c1 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:34:30.025050 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [req-9d277049-e915-460b-a9c2-2fc58bdbfb7f req-6581f80c-e0c8-451a-8c57-3374cca91330 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "24dce890-4ccc-4122-8b62-438ea395fb9a", "name": "network-vif-plugged", "status": "completed", "tag": "da1e5556-b87a-41c9-8727-30b8a9ea8c11"}]} {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 16:34:30.034483 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 24 16:34:30.034483 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: warnings.warn(msg) Jun 24 16:34:30.077335 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [req-9d277049-e915-460b-a9c2-2fc58bdbfb7f req-6581f80c-e0c8-451a-8c57-3374cca91330 service nova] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:34:30.079064 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [req-9d277049-e915-460b-a9c2-2fc58bdbfb7f req-6581f80c-e0c8-451a-8c57-3374cca91330 service nova] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:34:30.157289 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.compute.server_external_events [req-9d277049-e915-460b-a9c2-2fc58bdbfb7f req-6581f80c-e0c8-451a-8c57-3374cca91330 service nova] Creating event network-vif-plugged:da1e5556-b87a-41c9-8727-30b8a9ea8c11 for instance 24dce890-4ccc-4122-8b62-438ea395fb9a on hv-cinder-84718 Jun 24 16:34:30.184726 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [req-9d277049-e915-460b-a9c2-2fc58bdbfb7f req-6581f80c-e0c8-451a-8c57-3374cca91330 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.182862 Jun 24 16:34:30.185743 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 150/275] 10.222.0.18 () {64 vars in 1317 bytes} [Fri Jun 24 16:34:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 16:34:30.198683 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-09def1d5-596f-4fd1-85a7-20742b58081d tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Calling method '>' {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:34:30.199309 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-09def1d5-596f-4fd1-85a7-20742b58081d tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] [instance: 1739cd84-3709-4cf4-95e3-82de4b4d3d7a] Fetching instance by UUID {{(pid=102148) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:34:30.226045 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-09def1d5-596f-4fd1-85a7-20742b58081d tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:34:30.226678 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-09def1d5-596f-4fd1-85a7-20742b58081d tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:34:30.228311 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-09def1d5-596f-4fd1-85a7-20742b58081d tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:34:30.228973 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-09def1d5-596f-4fd1-85a7-20742b58081d tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:34:31.062290 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-09def1d5-596f-4fd1-85a7-20742b58081d tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] 10.222.0.18 "GET /compute/v2.1/servers/1739cd84-3709-4cf4-95e3-82de4b4d3d7a/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.873980 Jun 24 16:34:31.063660 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 151/276] 10.222.0.18 () {58 vars in 1274 bytes} [Fri Jun 24 16:34:30 2022] GET /compute/v2.1/servers/1739cd84-3709-4cf4-95e3-82de4b4d3d7a/os-interface => generated 285 bytes in 878 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 16:34:31.076739 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-cf7fc3b0-ea21-4c3f-b522-d261ba63233e tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Calling method '>' {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:34:31.084257 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-cf7fc3b0-ea21-4c3f-b522-d261ba63233e tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] [instance: 24dce890-4ccc-4122-8b62-438ea395fb9a] Fetching instance by UUID {{(pid=102148) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:34:31.119110 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-cf7fc3b0-ea21-4c3f-b522-d261ba63233e tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:34:31.120388 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-cf7fc3b0-ea21-4c3f-b522-d261ba63233e tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:34:31.123820 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-cf7fc3b0-ea21-4c3f-b522-d261ba63233e tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:34:31.127215 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-cf7fc3b0-ea21-4c3f-b522-d261ba63233e tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:34:31.227555 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-61033e86-3e5e-4a7e-be82-fc88071f00c1 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7489b29cb3ef47d78dfd55794f338b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065254ebe67545639644fcbc6bd9fc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:34:31.271916 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-61033e86-3e5e-4a7e-be82-fc88071f00c1 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7489b29cb3ef47d78dfd55794f338b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065254ebe67545639644fcbc6bd9fc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:34:31.274628 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-61033e86-3e5e-4a7e-be82-fc88071f00c1 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7489b29cb3ef47d78dfd55794f338b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065254ebe67545639644fcbc6bd9fc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:34:31.289402 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-61033e86-3e5e-4a7e-be82-fc88071f00c1 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] 10.222.0.18 "GET /compute/v2.1/servers/30b3ffec-7110-4b4d-9482-2451914c166f" status: 200 len: 1738 microversion: 2.20 time: 1.337108 Jun 24 16:34:31.290785 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 126/277] 10.222.0.18 () {60 vars in 1276 bytes} [Fri Jun 24 16:34:29 2022] GET /compute/v2.1/servers/30b3ffec-7110-4b4d-9482-2451914c166f => generated 1738 bytes in 1339 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 16:34:31.693518 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-cf7fc3b0-ea21-4c3f-b522-d261ba63233e tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '499faf87cf8c41ae823b2566e4c2d8ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606ba814a2d8408ab0856d539ca79b4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:34:31.774580 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-cf7fc3b0-ea21-4c3f-b522-d261ba63233e tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] 10.222.0.18 "GET /compute/v2.1/servers/24dce890-4ccc-4122-8b62-438ea395fb9a" status: 200 len: 1366 microversion: 2.1 time: 0.663504 Jun 24 16:34:31.774580 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 152/278] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:34:31 2022] GET /compute/v2.1/servers/24dce890-4ccc-4122-8b62-438ea395fb9a => generated 1366 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 16:34:32.329031 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-a1962462-2b8e-4de7-9a19-02aeb87292e6 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Calling method '>' {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:34:32.339456 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-a1962462-2b8e-4de7-9a19-02aeb87292e6 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] [instance: 30b3ffec-7110-4b4d-9482-2451914c166f] Fetching instance by UUID {{(pid=102149) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:34:32.366569 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-a1962462-2b8e-4de7-9a19-02aeb87292e6 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:34:32.367882 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-a1962462-2b8e-4de7-9a19-02aeb87292e6 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:34:32.369886 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-a1962462-2b8e-4de7-9a19-02aeb87292e6 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:34:32.371110 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-a1962462-2b8e-4de7-9a19-02aeb87292e6 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:34:32.770156 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-c56b5c93-26ca-452b-9ef8-1e13d177d808 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Calling method '>' {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:34:32.772720 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-c56b5c93-26ca-452b-9ef8-1e13d177d808 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] [instance: 24dce890-4ccc-4122-8b62-438ea395fb9a] Fetching instance by UUID {{(pid=102148) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:34:32.799994 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-c56b5c93-26ca-452b-9ef8-1e13d177d808 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:34:32.801351 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-c56b5c93-26ca-452b-9ef8-1e13d177d808 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:34:32.803061 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-c56b5c93-26ca-452b-9ef8-1e13d177d808 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:34:32.804130 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-c56b5c93-26ca-452b-9ef8-1e13d177d808 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:34:33.769730 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-a1962462-2b8e-4de7-9a19-02aeb87292e6 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7489b29cb3ef47d78dfd55794f338b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065254ebe67545639644fcbc6bd9fc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:34:33.788240 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-a1962462-2b8e-4de7-9a19-02aeb87292e6 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7489b29cb3ef47d78dfd55794f338b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065254ebe67545639644fcbc6bd9fc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:34:33.792271 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-a1962462-2b8e-4de7-9a19-02aeb87292e6 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7489b29cb3ef47d78dfd55794f338b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065254ebe67545639644fcbc6bd9fc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:34:33.793276 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-a1962462-2b8e-4de7-9a19-02aeb87292e6 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] 10.222.0.18 "GET /compute/v2.1/servers/30b3ffec-7110-4b4d-9482-2451914c166f" status: 200 len: 1738 microversion: 2.20 time: 1.476157 Jun 24 16:34:33.794122 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 127/279] 10.222.0.18 () {60 vars in 1276 bytes} [Fri Jun 24 16:34:32 2022] GET /compute/v2.1/servers/30b3ffec-7110-4b4d-9482-2451914c166f => generated 1738 bytes in 1478 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 16:34:34.033401 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-c56b5c93-26ca-452b-9ef8-1e13d177d808 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '499faf87cf8c41ae823b2566e4c2d8ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606ba814a2d8408ab0856d539ca79b4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:34:34.046813 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-c56b5c93-26ca-452b-9ef8-1e13d177d808 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] 10.222.0.18 "GET /compute/v2.1/servers/24dce890-4ccc-4122-8b62-438ea395fb9a" status: 200 len: 1556 microversion: 2.1 time: 1.285844 Jun 24 16:34:34.048116 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 153/280] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:34:32 2022] GET /compute/v2.1/servers/24dce890-4ccc-4122-8b62-438ea395fb9a => generated 1556 bytes in 1290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 16:34:34.078087 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-b5b61a3c-c8f1-4083-af0c-42b19ad3abed tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Calling method '>' {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:34:34.079058 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-b5b61a3c-c8f1-4083-af0c-42b19ad3abed tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] [instance: 24dce890-4ccc-4122-8b62-438ea395fb9a] Fetching instance by UUID {{(pid=102149) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:34:34.097226 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-b5b61a3c-c8f1-4083-af0c-42b19ad3abed tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:34:34.097668 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-b5b61a3c-c8f1-4083-af0c-42b19ad3abed tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:34:34.098470 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-b5b61a3c-c8f1-4083-af0c-42b19ad3abed tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:34:34.099290 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-b5b61a3c-c8f1-4083-af0c-42b19ad3abed tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:34:34.563460 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-b5b61a3c-c8f1-4083-af0c-42b19ad3abed tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] 10.222.0.18 "GET /compute/v2.1/servers/24dce890-4ccc-4122-8b62-438ea395fb9a/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.488749 Jun 24 16:34:34.566789 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 128/281] 10.222.0.18 () {58 vars in 1274 bytes} [Fri Jun 24 16:34:34 2022] GET /compute/v2.1/servers/24dce890-4ccc-4122-8b62-438ea395fb9a/os-interface => generated 284 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 16:34:34.837345 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-0c4d73db-a882-408f-8c37-5f9ef1c3d75f tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Calling method '>' {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:34:34.838712 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-0c4d73db-a882-408f-8c37-5f9ef1c3d75f tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] [instance: 30b3ffec-7110-4b4d-9482-2451914c166f] Fetching instance by UUID {{(pid=102148) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:34:34.875389 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-0c4d73db-a882-408f-8c37-5f9ef1c3d75f tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:34:34.876205 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-0c4d73db-a882-408f-8c37-5f9ef1c3d75f tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:34:34.877938 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-0c4d73db-a882-408f-8c37-5f9ef1c3d75f tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:34:34.879080 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-0c4d73db-a882-408f-8c37-5f9ef1c3d75f tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:34:35.717611 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-0c4d73db-a882-408f-8c37-5f9ef1c3d75f tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7489b29cb3ef47d78dfd55794f338b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065254ebe67545639644fcbc6bd9fc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:34:35.758232 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-0c4d73db-a882-408f-8c37-5f9ef1c3d75f tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7489b29cb3ef47d78dfd55794f338b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065254ebe67545639644fcbc6bd9fc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:34:35.761620 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-0c4d73db-a882-408f-8c37-5f9ef1c3d75f tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7489b29cb3ef47d78dfd55794f338b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065254ebe67545639644fcbc6bd9fc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:34:35.770772 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-0c4d73db-a882-408f-8c37-5f9ef1c3d75f tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] 10.222.0.18 "GET /compute/v2.1/servers/30b3ffec-7110-4b4d-9482-2451914c166f" status: 200 len: 1738 microversion: 2.20 time: 0.942697 Jun 24 16:34:35.783114 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 154/282] 10.222.0.18 () {60 vars in 1276 bytes} [Fri Jun 24 16:34:34 2022] GET /compute/v2.1/servers/30b3ffec-7110-4b4d-9482-2451914c166f => generated 1738 bytes in 956 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 16:34:36.759317 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [req-79bf154a-35be-40ec-9860-2f7d8d647051 req-2df26e6f-3f51-4433-9c9a-6cf0faa23630 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1739cd84-3709-4cf4-95e3-82de4b4d3d7a", "tag": "8a215961-1299-415e-b991-1271a78f7ae0"}]} {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 16:34:36.766865 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 24 16:34:36.766865 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: warnings.warn(msg) Jun 24 16:34:36.795166 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-f1a71c17-51fe-409b-a9a1-5aae1b50069c tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Calling method '>' {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:34:36.796378 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-f1a71c17-51fe-409b-a9a1-5aae1b50069c tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] [instance: 30b3ffec-7110-4b4d-9482-2451914c166f] Fetching instance by UUID {{(pid=102148) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:34:36.809912 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [req-79bf154a-35be-40ec-9860-2f7d8d647051 req-2df26e6f-3f51-4433-9c9a-6cf0faa23630 service nova] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:34:36.813985 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [req-79bf154a-35be-40ec-9860-2f7d8d647051 req-2df26e6f-3f51-4433-9c9a-6cf0faa23630 service nova] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:34:36.827703 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-f1a71c17-51fe-409b-a9a1-5aae1b50069c tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:34:36.828969 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-f1a71c17-51fe-409b-a9a1-5aae1b50069c tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:34:36.833908 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-f1a71c17-51fe-409b-a9a1-5aae1b50069c tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:34:36.838144 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-f1a71c17-51fe-409b-a9a1-5aae1b50069c tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:34:36.887708 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.compute.server_external_events [req-79bf154a-35be-40ec-9860-2f7d8d647051 req-2df26e6f-3f51-4433-9c9a-6cf0faa23630 service nova] Creating event network-changed:8a215961-1299-415e-b991-1271a78f7ae0 for instance 1739cd84-3709-4cf4-95e3-82de4b4d3d7a on hv-cinder-84718 Jun 24 16:34:36.917967 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [req-79bf154a-35be-40ec-9860-2f7d8d647051 req-2df26e6f-3f51-4433-9c9a-6cf0faa23630 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.170667 Jun 24 16:34:36.924348 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 129/283] 10.222.0.18 () {64 vars in 1317 bytes} [Fri Jun 24 16:34:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 16:34:38.118452 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-f1a71c17-51fe-409b-a9a1-5aae1b50069c tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7489b29cb3ef47d78dfd55794f338b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065254ebe67545639644fcbc6bd9fc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:34:38.135379 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-f1a71c17-51fe-409b-a9a1-5aae1b50069c tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7489b29cb3ef47d78dfd55794f338b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065254ebe67545639644fcbc6bd9fc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:34:38.140466 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-f1a71c17-51fe-409b-a9a1-5aae1b50069c tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7489b29cb3ef47d78dfd55794f338b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065254ebe67545639644fcbc6bd9fc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:34:38.149469 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-f1a71c17-51fe-409b-a9a1-5aae1b50069c tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] 10.222.0.18 "GET /compute/v2.1/servers/30b3ffec-7110-4b4d-9482-2451914c166f" status: 200 len: 1720 microversion: 2.20 time: 1.362086 Jun 24 16:34:38.157485 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 155/284] 10.222.0.18 () {60 vars in 1276 bytes} [Fri Jun 24 16:34:36 2022] GET /compute/v2.1/servers/30b3ffec-7110-4b4d-9482-2451914c166f => generated 1720 bytes in 1371 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 16:34:39.183022 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-9ef5a5b0-7830-4db3-bf49-2ba83c4c189d tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Calling method '>' {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:34:39.191778 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-9ef5a5b0-7830-4db3-bf49-2ba83c4c189d tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] [instance: 30b3ffec-7110-4b4d-9482-2451914c166f] Fetching instance by UUID {{(pid=102149) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:34:39.223560 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-9ef5a5b0-7830-4db3-bf49-2ba83c4c189d tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:34:39.228671 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-9ef5a5b0-7830-4db3-bf49-2ba83c4c189d tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:34:39.229905 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-9ef5a5b0-7830-4db3-bf49-2ba83c4c189d tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:34:39.230625 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-9ef5a5b0-7830-4db3-bf49-2ba83c4c189d tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:34:39.828851 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-9ef5a5b0-7830-4db3-bf49-2ba83c4c189d tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7489b29cb3ef47d78dfd55794f338b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065254ebe67545639644fcbc6bd9fc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:34:39.842227 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-9ef5a5b0-7830-4db3-bf49-2ba83c4c189d tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7489b29cb3ef47d78dfd55794f338b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065254ebe67545639644fcbc6bd9fc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:34:39.843900 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-9ef5a5b0-7830-4db3-bf49-2ba83c4c189d tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7489b29cb3ef47d78dfd55794f338b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065254ebe67545639644fcbc6bd9fc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:34:39.845161 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-9ef5a5b0-7830-4db3-bf49-2ba83c4c189d tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] 10.222.0.18 "GET /compute/v2.1/servers/30b3ffec-7110-4b4d-9482-2451914c166f" status: 200 len: 1720 microversion: 2.20 time: 0.669814 Jun 24 16:34:39.856324 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 130/285] 10.222.0.18 () {60 vars in 1276 bytes} [Fri Jun 24 16:34:39 2022] GET /compute/v2.1/servers/30b3ffec-7110-4b4d-9482-2451914c166f => generated 1720 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 16:34:40.618357 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [req-9589a08e-336a-4cd8-8d4b-1e7a9a9332c8 req-1614e533-a414-495f-8e1e-e86baac1522f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "24dce890-4ccc-4122-8b62-438ea395fb9a", "tag": "da1e5556-b87a-41c9-8727-30b8a9ea8c11"}]} {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 16:34:40.627373 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 24 16:34:40.627373 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: warnings.warn(msg) Jun 24 16:34:40.659607 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [req-9589a08e-336a-4cd8-8d4b-1e7a9a9332c8 req-1614e533-a414-495f-8e1e-e86baac1522f service nova] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:34:40.660121 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [req-9589a08e-336a-4cd8-8d4b-1e7a9a9332c8 req-1614e533-a414-495f-8e1e-e86baac1522f service nova] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:34:40.699538 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.compute.server_external_events [req-9589a08e-336a-4cd8-8d4b-1e7a9a9332c8 req-1614e533-a414-495f-8e1e-e86baac1522f service nova] Creating event network-changed:da1e5556-b87a-41c9-8727-30b8a9ea8c11 for instance 24dce890-4ccc-4122-8b62-438ea395fb9a on hv-cinder-84718 Jun 24 16:34:40.764206 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [req-9589a08e-336a-4cd8-8d4b-1e7a9a9332c8 req-1614e533-a414-495f-8e1e-e86baac1522f service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.150959 Jun 24 16:34:40.765348 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 156/286] 10.222.0.18 () {64 vars in 1317 bytes} [Fri Jun 24 16:34:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 16:34:40.922259 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-39ce72e8-2dd6-4fdd-84d5-97cdff10ee75 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Calling method '>' {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:34:40.923193 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-39ce72e8-2dd6-4fdd-84d5-97cdff10ee75 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] [instance: 30b3ffec-7110-4b4d-9482-2451914c166f] Fetching instance by UUID {{(pid=102149) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:34:40.962803 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-39ce72e8-2dd6-4fdd-84d5-97cdff10ee75 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:34:40.963492 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-39ce72e8-2dd6-4fdd-84d5-97cdff10ee75 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:34:40.964588 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-39ce72e8-2dd6-4fdd-84d5-97cdff10ee75 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:34:40.965264 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-39ce72e8-2dd6-4fdd-84d5-97cdff10ee75 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:34:41.807788 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-39ce72e8-2dd6-4fdd-84d5-97cdff10ee75 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7489b29cb3ef47d78dfd55794f338b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065254ebe67545639644fcbc6bd9fc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:34:41.876898 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-39ce72e8-2dd6-4fdd-84d5-97cdff10ee75 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7489b29cb3ef47d78dfd55794f338b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065254ebe67545639644fcbc6bd9fc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:34:41.888764 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-39ce72e8-2dd6-4fdd-84d5-97cdff10ee75 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7489b29cb3ef47d78dfd55794f338b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065254ebe67545639644fcbc6bd9fc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:34:41.900923 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-39ce72e8-2dd6-4fdd-84d5-97cdff10ee75 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] 10.222.0.18 "GET /compute/v2.1/servers/30b3ffec-7110-4b4d-9482-2451914c166f" status: 200 len: 1720 microversion: 2.20 time: 1.027863 Jun 24 16:34:41.902949 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 131/287] 10.222.0.18 () {60 vars in 1276 bytes} [Fri Jun 24 16:34:40 2022] GET /compute/v2.1/servers/30b3ffec-7110-4b4d-9482-2451914c166f => generated 1720 bytes in 1039 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 16:34:41.943061 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [req-be353e60-9926-40ac-ab5f-a38348639a77 req-63949007-d203-4613-a3b5-bc10d7e56ee4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "30b3ffec-7110-4b4d-9482-2451914c166f", "name": "network-vif-unplugged", "status": "completed", "tag": "78a4e31b-a598-4436-bdeb-0904cefd7b6e"}]} {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 16:34:41.945328 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 24 16:34:41.945328 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: warnings.warn(msg) Jun 24 16:34:41.965535 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [req-be353e60-9926-40ac-ab5f-a38348639a77 req-63949007-d203-4613-a3b5-bc10d7e56ee4 service nova] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:34:41.966458 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [req-be353e60-9926-40ac-ab5f-a38348639a77 req-63949007-d203-4613-a3b5-bc10d7e56ee4 service nova] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:34:42.023020 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.compute.server_external_events [req-be353e60-9926-40ac-ab5f-a38348639a77 req-63949007-d203-4613-a3b5-bc10d7e56ee4 service nova] Creating event network-vif-unplugged:78a4e31b-a598-4436-bdeb-0904cefd7b6e for instance 30b3ffec-7110-4b4d-9482-2451914c166f on hv-cinder-84718 Jun 24 16:34:42.038137 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [req-be353e60-9926-40ac-ab5f-a38348639a77 req-63949007-d203-4613-a3b5-bc10d7e56ee4 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.099860 Jun 24 16:34:42.046977 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 157/288] 10.222.0.18 () {64 vars in 1317 bytes} [Fri Jun 24 16:34:41 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 16:34:42.932647 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-3757a1ff-6908-46c2-9c5b-b194b6c3b7a6 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Calling method '>' {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:34:42.934875 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-3757a1ff-6908-46c2-9c5b-b194b6c3b7a6 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] [instance: 30b3ffec-7110-4b4d-9482-2451914c166f] Fetching instance by UUID {{(pid=102149) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:34:42.969718 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-3757a1ff-6908-46c2-9c5b-b194b6c3b7a6 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:34:42.970305 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-3757a1ff-6908-46c2-9c5b-b194b6c3b7a6 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:34:42.971540 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-3757a1ff-6908-46c2-9c5b-b194b6c3b7a6 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:34:42.976344 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-3757a1ff-6908-46c2-9c5b-b194b6c3b7a6 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:34:43.582866 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-3757a1ff-6908-46c2-9c5b-b194b6c3b7a6 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7489b29cb3ef47d78dfd55794f338b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065254ebe67545639644fcbc6bd9fc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:34:43.601531 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-3757a1ff-6908-46c2-9c5b-b194b6c3b7a6 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7489b29cb3ef47d78dfd55794f338b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065254ebe67545639644fcbc6bd9fc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:34:43.604590 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-3757a1ff-6908-46c2-9c5b-b194b6c3b7a6 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7489b29cb3ef47d78dfd55794f338b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065254ebe67545639644fcbc6bd9fc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:34:43.610870 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-3757a1ff-6908-46c2-9c5b-b194b6c3b7a6 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] 10.222.0.18 "GET /compute/v2.1/servers/30b3ffec-7110-4b4d-9482-2451914c166f" status: 200 len: 1663 microversion: 2.20 time: 0.678586 Jun 24 16:34:43.612249 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 132/289] 10.222.0.18 () {60 vars in 1276 bytes} [Fri Jun 24 16:34:42 2022] GET /compute/v2.1/servers/30b3ffec-7110-4b4d-9482-2451914c166f => generated 1663 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 16:34:43.648179 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-ec5347e3-90a2-4c35-827d-38db1007119c tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1598106d-a439-42b7-b406-ce5a40120d83"}} {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 16:34:43.663383 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-ec5347e3-90a2-4c35-827d-38db1007119c tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] [instance: 30b3ffec-7110-4b4d-9482-2451914c166f] Fetching instance by UUID {{(pid=102148) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:34:43.686574 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-ec5347e3-90a2-4c35-827d-38db1007119c tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:34:43.690914 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-ec5347e3-90a2-4c35-827d-38db1007119c tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:34:43.692237 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-ec5347e3-90a2-4c35-827d-38db1007119c tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:34:43.693404 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-ec5347e3-90a2-4c35-827d-38db1007119c tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:34:44.715013 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-ec5347e3-90a2-4c35-827d-38db1007119c tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] 10.222.0.18 "POST /compute/v2.1/servers/30b3ffec-7110-4b4d-9482-2451914c166f/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.080217 Jun 24 16:34:44.716050 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 158/290] 10.222.0.18 () {62 vars in 1363 bytes} [Fri Jun 24 16:34:43 2022] POST /compute/v2.1/servers/30b3ffec-7110-4b4d-9482-2451914c166f/os-volume_attachments => generated 188 bytes in 1084 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 16:34:45.065686 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-a5b90fd8-bbb8-4a10-a77e-5bf270891e03 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 16:34:45.067345 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-a5b90fd8-bbb8-4a10-a77e-5bf270891e03 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] [instance: 30b3ffec-7110-4b4d-9482-2451914c166f] Fetching instance by UUID {{(pid=102149) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:34:45.077738 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-a5b90fd8-bbb8-4a10-a77e-5bf270891e03 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:34:45.078187 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-a5b90fd8-bbb8-4a10-a77e-5bf270891e03 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:34:45.079216 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-a5b90fd8-bbb8-4a10-a77e-5bf270891e03 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:34:45.079860 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-a5b90fd8-bbb8-4a10-a77e-5bf270891e03 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:34:45.392054 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-a5b90fd8-bbb8-4a10-a77e-5bf270891e03 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] 10.222.0.18 "POST /compute/v2.1/servers/30b3ffec-7110-4b4d-9482-2451914c166f/action" status: 202 len: 0 microversion: 2.20 time: 0.331417 Jun 24 16:34:45.398955 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 133/291] 10.222.0.18 () {62 vars in 1318 bytes} [Fri Jun 24 16:34:45 2022] POST /compute/v2.1/servers/30b3ffec-7110-4b4d-9482-2451914c166f/action => generated 0 bytes in 339 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 24 16:34:45.408856 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-56c8ee0b-1687-4cc2-b0ac-d17525f00b68 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Calling method '>' {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:34:45.410591 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-56c8ee0b-1687-4cc2-b0ac-d17525f00b68 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] [instance: 30b3ffec-7110-4b4d-9482-2451914c166f] Fetching instance by UUID {{(pid=102148) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:34:45.452860 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-56c8ee0b-1687-4cc2-b0ac-d17525f00b68 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:34:45.453970 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-56c8ee0b-1687-4cc2-b0ac-d17525f00b68 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:34:45.455288 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-56c8ee0b-1687-4cc2-b0ac-d17525f00b68 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:34:45.456256 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-56c8ee0b-1687-4cc2-b0ac-d17525f00b68 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:34:45.809075 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-56c8ee0b-1687-4cc2-b0ac-d17525f00b68 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7489b29cb3ef47d78dfd55794f338b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065254ebe67545639644fcbc6bd9fc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:34:45.825852 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-56c8ee0b-1687-4cc2-b0ac-d17525f00b68 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7489b29cb3ef47d78dfd55794f338b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065254ebe67545639644fcbc6bd9fc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:34:45.827511 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-56c8ee0b-1687-4cc2-b0ac-d17525f00b68 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7489b29cb3ef47d78dfd55794f338b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065254ebe67545639644fcbc6bd9fc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:34:45.829378 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-56c8ee0b-1687-4cc2-b0ac-d17525f00b68 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] 10.222.0.18 "GET /compute/v2.1/servers/30b3ffec-7110-4b4d-9482-2451914c166f" status: 200 len: 1749 microversion: 2.20 time: 0.429489 Jun 24 16:34:45.830135 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 159/292] 10.222.0.18 () {60 vars in 1276 bytes} [Fri Jun 24 16:34:45 2022] GET /compute/v2.1/servers/30b3ffec-7110-4b4d-9482-2451914c166f => generated 1749 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 16:34:46.862751 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-2bbd862c-f51a-4b16-9b75-17b0d02fe9b4 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Calling method '>' {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:34:46.864585 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-2bbd862c-f51a-4b16-9b75-17b0d02fe9b4 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] [instance: 30b3ffec-7110-4b4d-9482-2451914c166f] Fetching instance by UUID {{(pid=102149) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:34:46.878166 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-2bbd862c-f51a-4b16-9b75-17b0d02fe9b4 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:34:46.879484 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-2bbd862c-f51a-4b16-9b75-17b0d02fe9b4 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:34:46.881073 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-2bbd862c-f51a-4b16-9b75-17b0d02fe9b4 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:34:46.882078 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-2bbd862c-f51a-4b16-9b75-17b0d02fe9b4 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:34:47.245705 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-2bbd862c-f51a-4b16-9b75-17b0d02fe9b4 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7489b29cb3ef47d78dfd55794f338b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065254ebe67545639644fcbc6bd9fc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:34:47.270629 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-2bbd862c-f51a-4b16-9b75-17b0d02fe9b4 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7489b29cb3ef47d78dfd55794f338b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065254ebe67545639644fcbc6bd9fc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:34:47.273079 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-2bbd862c-f51a-4b16-9b75-17b0d02fe9b4 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7489b29cb3ef47d78dfd55794f338b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065254ebe67545639644fcbc6bd9fc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:34:47.275234 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-2bbd862c-f51a-4b16-9b75-17b0d02fe9b4 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] 10.222.0.18 "GET /compute/v2.1/servers/30b3ffec-7110-4b4d-9482-2451914c166f" status: 200 len: 1749 microversion: 2.20 time: 0.421448 Jun 24 16:34:47.276758 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 134/293] 10.222.0.18 () {60 vars in 1276 bytes} [Fri Jun 24 16:34:46 2022] GET /compute/v2.1/servers/30b3ffec-7110-4b4d-9482-2451914c166f => generated 1749 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 16:34:48.303588 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-c2a990e7-9f88-4406-bb8c-f8ccdc5f11c0 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Calling method '>' {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:34:48.304704 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-c2a990e7-9f88-4406-bb8c-f8ccdc5f11c0 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] [instance: 30b3ffec-7110-4b4d-9482-2451914c166f] Fetching instance by UUID {{(pid=102148) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:34:48.313690 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-c2a990e7-9f88-4406-bb8c-f8ccdc5f11c0 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:34:48.314647 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-c2a990e7-9f88-4406-bb8c-f8ccdc5f11c0 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:34:48.315749 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-c2a990e7-9f88-4406-bb8c-f8ccdc5f11c0 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:34:48.316229 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-c2a990e7-9f88-4406-bb8c-f8ccdc5f11c0 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:34:48.772233 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-c2a990e7-9f88-4406-bb8c-f8ccdc5f11c0 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7489b29cb3ef47d78dfd55794f338b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065254ebe67545639644fcbc6bd9fc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:34:48.797754 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-c2a990e7-9f88-4406-bb8c-f8ccdc5f11c0 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7489b29cb3ef47d78dfd55794f338b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065254ebe67545639644fcbc6bd9fc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:34:48.802150 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-c2a990e7-9f88-4406-bb8c-f8ccdc5f11c0 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7489b29cb3ef47d78dfd55794f338b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065254ebe67545639644fcbc6bd9fc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:34:48.804985 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-c2a990e7-9f88-4406-bb8c-f8ccdc5f11c0 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] 10.222.0.18 "GET /compute/v2.1/servers/30b3ffec-7110-4b4d-9482-2451914c166f" status: 200 len: 1749 microversion: 2.20 time: 0.506126 Jun 24 16:34:48.806861 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 160/294] 10.222.0.18 () {60 vars in 1276 bytes} [Fri Jun 24 16:34:48 2022] GET /compute/v2.1/servers/30b3ffec-7110-4b4d-9482-2451914c166f => generated 1749 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 16:34:49.837041 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-c36155f4-7395-4940-bdc5-5956e838f1c4 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Calling method '>' {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:34:49.838108 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-c36155f4-7395-4940-bdc5-5956e838f1c4 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] [instance: 30b3ffec-7110-4b4d-9482-2451914c166f] Fetching instance by UUID {{(pid=102149) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:34:49.851236 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-c36155f4-7395-4940-bdc5-5956e838f1c4 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:34:49.852022 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-c36155f4-7395-4940-bdc5-5956e838f1c4 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:34:49.853348 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-c36155f4-7395-4940-bdc5-5956e838f1c4 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:34:49.854086 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-c36155f4-7395-4940-bdc5-5956e838f1c4 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:34:50.180649 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-c36155f4-7395-4940-bdc5-5956e838f1c4 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7489b29cb3ef47d78dfd55794f338b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065254ebe67545639644fcbc6bd9fc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:34:50.196607 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-c36155f4-7395-4940-bdc5-5956e838f1c4 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7489b29cb3ef47d78dfd55794f338b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065254ebe67545639644fcbc6bd9fc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:34:50.199856 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-c36155f4-7395-4940-bdc5-5956e838f1c4 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7489b29cb3ef47d78dfd55794f338b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065254ebe67545639644fcbc6bd9fc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:34:50.206836 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-c36155f4-7395-4940-bdc5-5956e838f1c4 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] 10.222.0.18 "GET /compute/v2.1/servers/30b3ffec-7110-4b4d-9482-2451914c166f" status: 200 len: 1751 microversion: 2.20 time: 0.371268 Jun 24 16:34:50.209074 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 135/295] 10.222.0.18 () {60 vars in 1276 bytes} [Fri Jun 24 16:34:49 2022] GET /compute/v2.1/servers/30b3ffec-7110-4b4d-9482-2451914c166f => generated 1751 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 16:34:51.239526 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-7245c17d-fd57-42d7-a94e-407f01e4509f tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Calling method '>' {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:34:51.240394 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-7245c17d-fd57-42d7-a94e-407f01e4509f tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] [instance: 30b3ffec-7110-4b4d-9482-2451914c166f] Fetching instance by UUID {{(pid=102148) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:34:51.250884 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-7245c17d-fd57-42d7-a94e-407f01e4509f tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:34:51.251509 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-7245c17d-fd57-42d7-a94e-407f01e4509f tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:34:51.252743 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-7245c17d-fd57-42d7-a94e-407f01e4509f tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:34:51.253551 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-7245c17d-fd57-42d7-a94e-407f01e4509f tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:34:51.580445 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-7245c17d-fd57-42d7-a94e-407f01e4509f tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7489b29cb3ef47d78dfd55794f338b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065254ebe67545639644fcbc6bd9fc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:34:51.597823 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-7245c17d-fd57-42d7-a94e-407f01e4509f tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7489b29cb3ef47d78dfd55794f338b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065254ebe67545639644fcbc6bd9fc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:34:51.600671 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-7245c17d-fd57-42d7-a94e-407f01e4509f tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7489b29cb3ef47d78dfd55794f338b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065254ebe67545639644fcbc6bd9fc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:34:51.602230 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-7245c17d-fd57-42d7-a94e-407f01e4509f tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] 10.222.0.18 "GET /compute/v2.1/servers/30b3ffec-7110-4b4d-9482-2451914c166f" status: 200 len: 1807 microversion: 2.20 time: 0.367836 Jun 24 16:34:51.603247 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 161/296] 10.222.0.18 () {60 vars in 1276 bytes} [Fri Jun 24 16:34:51 2022] GET /compute/v2.1/servers/30b3ffec-7110-4b4d-9482-2451914c166f => generated 1807 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 16:34:52.633667 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-0cd00662-0740-48b8-a809-d3bba728b020 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Calling method '>' {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:34:52.637153 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-0cd00662-0740-48b8-a809-d3bba728b020 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] [instance: 30b3ffec-7110-4b4d-9482-2451914c166f] Fetching instance by UUID {{(pid=102149) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:34:52.654292 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-0cd00662-0740-48b8-a809-d3bba728b020 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:34:52.656365 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-0cd00662-0740-48b8-a809-d3bba728b020 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:34:52.657938 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-0cd00662-0740-48b8-a809-d3bba728b020 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:34:52.659126 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-0cd00662-0740-48b8-a809-d3bba728b020 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:34:53.516140 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-0cd00662-0740-48b8-a809-d3bba728b020 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7489b29cb3ef47d78dfd55794f338b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065254ebe67545639644fcbc6bd9fc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:34:53.541712 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-0cd00662-0740-48b8-a809-d3bba728b020 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7489b29cb3ef47d78dfd55794f338b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065254ebe67545639644fcbc6bd9fc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:34:53.545773 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-0cd00662-0740-48b8-a809-d3bba728b020 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7489b29cb3ef47d78dfd55794f338b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065254ebe67545639644fcbc6bd9fc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:34:53.547425 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-0cd00662-0740-48b8-a809-d3bba728b020 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] 10.222.0.18 "GET /compute/v2.1/servers/30b3ffec-7110-4b4d-9482-2451914c166f" status: 200 len: 1807 microversion: 2.20 time: 0.923192 Jun 24 16:34:53.548511 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 136/297] 10.222.0.18 () {60 vars in 1276 bytes} [Fri Jun 24 16:34:52 2022] GET /compute/v2.1/servers/30b3ffec-7110-4b4d-9482-2451914c166f => generated 1807 bytes in 925 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 16:34:54.599409 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-c9812d98-4ac1-4863-a40e-0640996753ad tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Calling method '>' {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:34:54.601760 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-c9812d98-4ac1-4863-a40e-0640996753ad tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] [instance: 30b3ffec-7110-4b4d-9482-2451914c166f] Fetching instance by UUID {{(pid=102148) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:34:54.619845 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-c9812d98-4ac1-4863-a40e-0640996753ad tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:34:54.622304 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-c9812d98-4ac1-4863-a40e-0640996753ad tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:34:54.626434 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-c9812d98-4ac1-4863-a40e-0640996753ad tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:34:54.627628 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-c9812d98-4ac1-4863-a40e-0640996753ad tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:34:55.221424 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-c9812d98-4ac1-4863-a40e-0640996753ad tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7489b29cb3ef47d78dfd55794f338b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065254ebe67545639644fcbc6bd9fc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:34:55.277492 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-c9812d98-4ac1-4863-a40e-0640996753ad tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7489b29cb3ef47d78dfd55794f338b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065254ebe67545639644fcbc6bd9fc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:34:55.280466 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-c9812d98-4ac1-4863-a40e-0640996753ad tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7489b29cb3ef47d78dfd55794f338b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065254ebe67545639644fcbc6bd9fc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:34:55.282823 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-c9812d98-4ac1-4863-a40e-0640996753ad tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] 10.222.0.18 "GET /compute/v2.1/servers/30b3ffec-7110-4b4d-9482-2451914c166f" status: 200 len: 1807 microversion: 2.20 time: 0.697288 Jun 24 16:34:55.298726 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 162/298] 10.222.0.18 () {60 vars in 1276 bytes} [Fri Jun 24 16:34:54 2022] GET /compute/v2.1/servers/30b3ffec-7110-4b4d-9482-2451914c166f => generated 1807 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 16:34:56.263499 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-a43f9a40-4023-48ec-9b2b-5082cac619da tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-489912781", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-306670203", "security_groups": [{"name": "tempest-secgroup-smoke-1405128976"}], "block_device_mapping_v2": [{"uuid": "87fd089a-edfc-453b-a4a7-c7b1dcc2ca55", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "e44350f6-4ad8-4a19-8963-bdb0aaadab4f"}]}} {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 16:34:56.316005 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-9bc625aa-0287-4c92-862f-fbdf215f121c tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Calling method '>' {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:34:56.319739 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-9bc625aa-0287-4c92-862f-fbdf215f121c tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] [instance: 30b3ffec-7110-4b4d-9482-2451914c166f] Fetching instance by UUID {{(pid=102148) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:34:56.379439 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-9bc625aa-0287-4c92-862f-fbdf215f121c tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:34:56.381979 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-9bc625aa-0287-4c92-862f-fbdf215f121c tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:34:56.390609 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-9bc625aa-0287-4c92-862f-fbdf215f121c tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:34:56.393595 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-9bc625aa-0287-4c92-862f-fbdf215f121c tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:34:56.710883 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.network.neutron [None req-a43f9a40-4023-48ec-9b2b-5082cac619da tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] validate_networks() for [('e44350f6-4ad8-4a19-8963-bdb0aaadab4f', None, None, None)] {{(pid=102149) validate_networks /opt/stack/nova/nova/network/neutron.py:2367}} Jun 24 16:34:57.977432 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-9bc625aa-0287-4c92-862f-fbdf215f121c tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7489b29cb3ef47d78dfd55794f338b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065254ebe67545639644fcbc6bd9fc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:34:58.005228 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-9bc625aa-0287-4c92-862f-fbdf215f121c tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7489b29cb3ef47d78dfd55794f338b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065254ebe67545639644fcbc6bd9fc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:34:58.007490 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-9bc625aa-0287-4c92-862f-fbdf215f121c tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7489b29cb3ef47d78dfd55794f338b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065254ebe67545639644fcbc6bd9fc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:34:58.021858 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-9bc625aa-0287-4c92-862f-fbdf215f121c tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] 10.222.0.18 "GET /compute/v2.1/servers/30b3ffec-7110-4b4d-9482-2451914c166f" status: 200 len: 1807 microversion: 2.20 time: 1.702508 Jun 24 16:34:58.023637 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 163/299] 10.222.0.18 () {60 vars in 1276 bytes} [Fri Jun 24 16:34:56 2022] GET /compute/v2.1/servers/30b3ffec-7110-4b4d-9482-2451914c166f => generated 1807 bytes in 1716 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 16:34:59.052568 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-053a65a2-24dc-4fab-bde9-cbcaae1f75d5 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Calling method '>' {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:34:59.054604 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-053a65a2-24dc-4fab-bde9-cbcaae1f75d5 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] [instance: 30b3ffec-7110-4b4d-9482-2451914c166f] Fetching instance by UUID {{(pid=102148) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:34:59.103522 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-053a65a2-24dc-4fab-bde9-cbcaae1f75d5 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:34:59.105815 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-053a65a2-24dc-4fab-bde9-cbcaae1f75d5 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:34:59.111289 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-053a65a2-24dc-4fab-bde9-cbcaae1f75d5 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:34:59.114851 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-053a65a2-24dc-4fab-bde9-cbcaae1f75d5 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:34:59.384823 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.virt.hardware [None req-a43f9a40-4023-48ec-9b2b-5082cac619da tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Flavor limits 0:0:0 {{(pid=102149) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 24 16:34:59.385759 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.virt.hardware [None req-a43f9a40-4023-48ec-9b2b-5082cac619da tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Image limits 0:0:0 {{(pid=102149) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 24 16:34:59.387161 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.virt.hardware [None req-a43f9a40-4023-48ec-9b2b-5082cac619da tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Flavor pref 0:0:0 {{(pid=102149) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 24 16:34:59.388275 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.virt.hardware [None req-a43f9a40-4023-48ec-9b2b-5082cac619da tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Image pref 0:0:0 {{(pid=102149) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 24 16:34:59.389342 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.virt.hardware [None req-a43f9a40-4023-48ec-9b2b-5082cac619da tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=102149) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 24 16:34:59.442289 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-a43f9a40-4023-48ec-9b2b-5082cac619da tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:34:59.443081 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-a43f9a40-4023-48ec-9b2b-5082cac619da tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:34:59.444140 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-a43f9a40-4023-48ec-9b2b-5082cac619da tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:34:59.444841 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-a43f9a40-4023-48ec-9b2b-5082cac619da tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:34:59.550089 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.quota [None req-a43f9a40-4023-48ec-9b2b-5082cac619da tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Getting quotas for project 901fbc33d59d49f8afa7f06d62e19e16. Resources: {'ram', 'instances', 'cores'} {{(pid=102149) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jun 24 16:34:59.573154 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.quota [None req-a43f9a40-4023-48ec-9b2b-5082cac619da tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Getting quotas for user 65d11cab328748d5a8f5e55eb439e334 and project 901fbc33d59d49f8afa7f06d62e19e16. Resources: {'ram', 'instances', 'cores'} {{(pid=102149) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jun 24 16:34:59.895344 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-a43f9a40-4023-48ec-9b2b-5082cac619da tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Going to run 1 instances... {{(pid=102149) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Jun 24 16:34:59.901609 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-a43f9a40-4023-48ec-9b2b-5082cac619da tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] [instance: 2b6c814b-481d-4fba-8cd7-c84aee3f7572] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='87fd089a-edfc-453b-a4a7-c7b1dcc2ca55',volume_size=None,volume_type=None)] {{(pid=102149) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1684}} Jun 24 16:34:59.947405 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-053a65a2-24dc-4fab-bde9-cbcaae1f75d5 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7489b29cb3ef47d78dfd55794f338b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065254ebe67545639644fcbc6bd9fc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:34:59.992270 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-053a65a2-24dc-4fab-bde9-cbcaae1f75d5 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7489b29cb3ef47d78dfd55794f338b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065254ebe67545639644fcbc6bd9fc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:34:59.995833 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-053a65a2-24dc-4fab-bde9-cbcaae1f75d5 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7489b29cb3ef47d78dfd55794f338b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065254ebe67545639644fcbc6bd9fc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:34:59.998423 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-053a65a2-24dc-4fab-bde9-cbcaae1f75d5 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] 10.222.0.18 "GET /compute/v2.1/servers/30b3ffec-7110-4b4d-9482-2451914c166f" status: 200 len: 1807 microversion: 2.20 time: 0.959025 Jun 24 16:34:59.999931 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 164/300] 10.222.0.18 () {60 vars in 1276 bytes} [Fri Jun 24 16:34:59 2022] GET /compute/v2.1/servers/30b3ffec-7110-4b4d-9482-2451914c166f => generated 1807 bytes in 962 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 16:35:00.758080 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-a43f9a40-4023-48ec-9b2b-5082cac619da tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 4.496713 Jun 24 16:35:00.768379 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 137/301] 10.222.0.18 () {60 vars in 1146 bytes} [Fri Jun 24 16:34:56 2022] POST /compute/v2.1/servers => generated 406 bytes in 4510 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 24 16:35:00.775769 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-9ad28d3c-a9c2-40bc-855a-0d70f89400de tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Calling method '>' {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:35:00.777976 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-9ad28d3c-a9c2-40bc-855a-0d70f89400de tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] [instance: 2b6c814b-481d-4fba-8cd7-c84aee3f7572] Fetching instance by UUID {{(pid=102148) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:35:01.032188 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-9ad28d3c-a9c2-40bc-855a-0d70f89400de tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65d11cab328748d5a8f5e55eb439e334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901fbc33d59d49f8afa7f06d62e19e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:35:01.036919 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-f51c4441-11c6-42cf-8c4b-6aae728a12d4 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Calling method '>' {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:35:01.045105 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-f51c4441-11c6-42cf-8c4b-6aae728a12d4 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] [instance: 30b3ffec-7110-4b4d-9482-2451914c166f] Fetching instance by UUID {{(pid=102149) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:35:01.072354 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-9ad28d3c-a9c2-40bc-855a-0d70f89400de tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] 10.222.0.18 "GET /compute/v2.1/servers/2b6c814b-481d-4fba-8cd7-c84aee3f7572" status: 200 len: 1093 microversion: 2.1 time: 0.302679 Jun 24 16:35:01.072598 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-f51c4441-11c6-42cf-8c4b-6aae728a12d4 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:35:01.073096 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-f51c4441-11c6-42cf-8c4b-6aae728a12d4 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:35:01.075107 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 165/302] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:35:00 2022] GET /compute/v2.1/servers/2b6c814b-481d-4fba-8cd7-c84aee3f7572 => generated 1093 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 16:35:01.091733 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-f51c4441-11c6-42cf-8c4b-6aae728a12d4 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:35:01.093138 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-f51c4441-11c6-42cf-8c4b-6aae728a12d4 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:35:01.782193 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-e0000ee0-ef70-48f9-9974-df643e4ad46c tempest-VolumesSnapshotTestJSON-1294974655 tempest-VolumesSnapshotTestJSON-1294974655-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1213976718", "imageRef": "113c9cfb-6cee-4018-9e63-66fae82b3851", "flavorRef": "452", "networks": [{"uuid": "9e95becd-dade-458e-967f-348562028446"}]}} {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 16:35:01.827923 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-f51c4441-11c6-42cf-8c4b-6aae728a12d4 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7489b29cb3ef47d78dfd55794f338b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065254ebe67545639644fcbc6bd9fc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:35:01.848119 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-f51c4441-11c6-42cf-8c4b-6aae728a12d4 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7489b29cb3ef47d78dfd55794f338b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065254ebe67545639644fcbc6bd9fc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:35:01.852279 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-f51c4441-11c6-42cf-8c4b-6aae728a12d4 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7489b29cb3ef47d78dfd55794f338b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065254ebe67545639644fcbc6bd9fc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:35:01.855495 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-f51c4441-11c6-42cf-8c4b-6aae728a12d4 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] 10.222.0.18 "GET /compute/v2.1/servers/30b3ffec-7110-4b4d-9482-2451914c166f" status: 200 len: 1807 microversion: 2.20 time: 0.828006 Jun 24 16:35:01.868314 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 138/303] 10.222.0.18 () {60 vars in 1276 bytes} [Fri Jun 24 16:35:01 2022] GET /compute/v2.1/servers/30b3ffec-7110-4b4d-9482-2451914c166f => generated 1807 bytes in 842 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 16:35:01.971285 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.network.neutron [None req-e0000ee0-ef70-48f9-9974-df643e4ad46c tempest-VolumesSnapshotTestJSON-1294974655 tempest-VolumesSnapshotTestJSON-1294974655-project] validate_networks() for [('9e95becd-dade-458e-967f-348562028446', None, None, None)] {{(pid=102148) validate_networks /opt/stack/nova/nova/network/neutron.py:2367}} Jun 24 16:35:02.104571 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-87a479f4-ce3e-42bb-be8d-e3820dc302be tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Calling method '>' {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:35:02.107276 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-87a479f4-ce3e-42bb-be8d-e3820dc302be tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] [instance: 2b6c814b-481d-4fba-8cd7-c84aee3f7572] Fetching instance by UUID {{(pid=102149) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:35:02.128247 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-87a479f4-ce3e-42bb-be8d-e3820dc302be tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:35:02.129734 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-87a479f4-ce3e-42bb-be8d-e3820dc302be tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:35:02.132068 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-87a479f4-ce3e-42bb-be8d-e3820dc302be tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:35:02.135196 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-87a479f4-ce3e-42bb-be8d-e3820dc302be tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:35:02.498104 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-87a479f4-ce3e-42bb-be8d-e3820dc302be tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65d11cab328748d5a8f5e55eb439e334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901fbc33d59d49f8afa7f06d62e19e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:35:02.543077 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-87a479f4-ce3e-42bb-be8d-e3820dc302be tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] 10.222.0.18 "GET /compute/v2.1/servers/2b6c814b-481d-4fba-8cd7-c84aee3f7572" status: 200 len: 1143 microversion: 2.1 time: 0.442961 Jun 24 16:35:02.546654 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 139/304] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:35:02 2022] GET /compute/v2.1/servers/2b6c814b-481d-4fba-8cd7-c84aee3f7572 => generated 1143 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 16:35:02.891434 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-f365fcff-7f38-4d75-becf-f671a8b778e3 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Calling method '>' {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:35:02.895938 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-f365fcff-7f38-4d75-becf-f671a8b778e3 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] [instance: 30b3ffec-7110-4b4d-9482-2451914c166f] Fetching instance by UUID {{(pid=102149) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:35:02.939239 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-f365fcff-7f38-4d75-becf-f671a8b778e3 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:35:02.945518 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-f365fcff-7f38-4d75-becf-f671a8b778e3 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:35:02.949068 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-f365fcff-7f38-4d75-becf-f671a8b778e3 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:35:02.952665 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-f365fcff-7f38-4d75-becf-f671a8b778e3 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:35:03.850508 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.virt.hardware [None req-e0000ee0-ef70-48f9-9974-df643e4ad46c tempest-VolumesSnapshotTestJSON-1294974655 tempest-VolumesSnapshotTestJSON-1294974655-project] Flavor limits 0:0:0 {{(pid=102148) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 24 16:35:03.852598 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.virt.hardware [None req-e0000ee0-ef70-48f9-9974-df643e4ad46c tempest-VolumesSnapshotTestJSON-1294974655 tempest-VolumesSnapshotTestJSON-1294974655-project] Image limits 0:0:0 {{(pid=102148) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 24 16:35:03.853758 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.virt.hardware [None req-e0000ee0-ef70-48f9-9974-df643e4ad46c tempest-VolumesSnapshotTestJSON-1294974655 tempest-VolumesSnapshotTestJSON-1294974655-project] Flavor pref 0:0:0 {{(pid=102148) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 24 16:35:03.855869 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.virt.hardware [None req-e0000ee0-ef70-48f9-9974-df643e4ad46c tempest-VolumesSnapshotTestJSON-1294974655 tempest-VolumesSnapshotTestJSON-1294974655-project] Image pref 0:0:0 {{(pid=102148) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 24 16:35:03.856906 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.virt.hardware [None req-e0000ee0-ef70-48f9-9974-df643e4ad46c tempest-VolumesSnapshotTestJSON-1294974655 tempest-VolumesSnapshotTestJSON-1294974655-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=102148) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 24 16:35:03.896526 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-e0000ee0-ef70-48f9-9974-df643e4ad46c tempest-VolumesSnapshotTestJSON-1294974655 tempest-VolumesSnapshotTestJSON-1294974655-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:35:03.897662 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-e0000ee0-ef70-48f9-9974-df643e4ad46c tempest-VolumesSnapshotTestJSON-1294974655 tempest-VolumesSnapshotTestJSON-1294974655-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:35:03.900095 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-e0000ee0-ef70-48f9-9974-df643e4ad46c tempest-VolumesSnapshotTestJSON-1294974655 tempest-VolumesSnapshotTestJSON-1294974655-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:35:03.903925 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-e0000ee0-ef70-48f9-9974-df643e4ad46c tempest-VolumesSnapshotTestJSON-1294974655 tempest-VolumesSnapshotTestJSON-1294974655-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:35:03.983836 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.quota [None req-e0000ee0-ef70-48f9-9974-df643e4ad46c tempest-VolumesSnapshotTestJSON-1294974655 tempest-VolumesSnapshotTestJSON-1294974655-project] Getting quotas for project de0966981b5f4c3fa17c73c0c4b31779. Resources: {'ram', 'instances', 'cores'} {{(pid=102148) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jun 24 16:35:04.005241 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.quota [None req-e0000ee0-ef70-48f9-9974-df643e4ad46c tempest-VolumesSnapshotTestJSON-1294974655 tempest-VolumesSnapshotTestJSON-1294974655-project] Getting quotas for user a7b98bac241449c9a8b14307e4f7993a and project de0966981b5f4c3fa17c73c0c4b31779. Resources: {'ram', 'instances', 'cores'} {{(pid=102148) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jun 24 16:35:04.041709 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-f365fcff-7f38-4d75-becf-f671a8b778e3 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7489b29cb3ef47d78dfd55794f338b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065254ebe67545639644fcbc6bd9fc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:35:04.072551 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-e0000ee0-ef70-48f9-9974-df643e4ad46c tempest-VolumesSnapshotTestJSON-1294974655 tempest-VolumesSnapshotTestJSON-1294974655-project] Going to run 1 instances... {{(pid=102148) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Jun 24 16:35:04.076706 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-e0000ee0-ef70-48f9-9974-df643e4ad46c tempest-VolumesSnapshotTestJSON-1294974655 tempest-VolumesSnapshotTestJSON-1294974655-project] [instance: ebd2b19d-ddad-422b-a276-0fb7cbe80753] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='113c9cfb-6cee-4018-9e63-66fae82b3851',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=102148) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1684}} Jun 24 16:35:04.080653 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-f365fcff-7f38-4d75-becf-f671a8b778e3 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7489b29cb3ef47d78dfd55794f338b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065254ebe67545639644fcbc6bd9fc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:35:04.084252 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-f365fcff-7f38-4d75-becf-f671a8b778e3 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7489b29cb3ef47d78dfd55794f338b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065254ebe67545639644fcbc6bd9fc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:35:04.087040 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-f365fcff-7f38-4d75-becf-f671a8b778e3 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] 10.222.0.18 "GET /compute/v2.1/servers/30b3ffec-7110-4b4d-9482-2451914c166f" status: 200 len: 1807 microversion: 2.20 time: 1.203418 Jun 24 16:35:04.088119 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 140/305] 10.222.0.18 () {60 vars in 1276 bytes} [Fri Jun 24 16:35:02 2022] GET /compute/v2.1/servers/30b3ffec-7110-4b4d-9482-2451914c166f => generated 1807 bytes in 1206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 16:35:04.116093 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-b92abf53-bf04-483a-9bac-aa9d013e41b1 tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Calling method '>' {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:35:04.117688 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-b92abf53-bf04-483a-9bac-aa9d013e41b1 tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] [instance: 2b6c814b-481d-4fba-8cd7-c84aee3f7572] Fetching instance by UUID {{(pid=102149) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:35:04.134740 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-b92abf53-bf04-483a-9bac-aa9d013e41b1 tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:35:04.136943 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-b92abf53-bf04-483a-9bac-aa9d013e41b1 tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:35:04.139579 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-b92abf53-bf04-483a-9bac-aa9d013e41b1 tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:35:04.140624 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-b92abf53-bf04-483a-9bac-aa9d013e41b1 tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:35:04.246874 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-e0000ee0-ef70-48f9-9974-df643e4ad46c tempest-VolumesSnapshotTestJSON-1294974655 tempest-VolumesSnapshotTestJSON-1294974655-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.471995 Jun 24 16:35:04.256998 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 166/306] 10.222.0.18 () {60 vars in 1146 bytes} [Fri Jun 24 16:35:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 2478 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 24 16:35:04.280026 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-5e9661d2-9780-4b34-b638-707dbe171475 tempest-VolumesSnapshotTestJSON-1294974655 tempest-VolumesSnapshotTestJSON-1294974655-project] Calling method '>' {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:35:04.280916 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-5e9661d2-9780-4b34-b638-707dbe171475 tempest-VolumesSnapshotTestJSON-1294974655 tempest-VolumesSnapshotTestJSON-1294974655-project] [instance: ebd2b19d-ddad-422b-a276-0fb7cbe80753] Fetching instance by UUID {{(pid=102148) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:35:04.655972 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-b92abf53-bf04-483a-9bac-aa9d013e41b1 tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65d11cab328748d5a8f5e55eb439e334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901fbc33d59d49f8afa7f06d62e19e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:35:04.668132 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-b92abf53-bf04-483a-9bac-aa9d013e41b1 tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] 10.222.0.18 "GET /compute/v2.1/servers/2b6c814b-481d-4fba-8cd7-c84aee3f7572" status: 200 len: 1191 microversion: 2.1 time: 0.577601 Jun 24 16:35:04.673326 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 141/307] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:35:04 2022] GET /compute/v2.1/servers/2b6c814b-481d-4fba-8cd7-c84aee3f7572 => generated 1191 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 16:35:04.698466 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-5e9661d2-9780-4b34-b638-707dbe171475 tempest-VolumesSnapshotTestJSON-1294974655 tempest-VolumesSnapshotTestJSON-1294974655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7b98bac241449c9a8b14307e4f7993a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0966981b5f4c3fa17c73c0c4b31779', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:35:04.724846 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-5e9661d2-9780-4b34-b638-707dbe171475 tempest-VolumesSnapshotTestJSON-1294974655 tempest-VolumesSnapshotTestJSON-1294974655-project] 10.222.0.18 "GET /compute/v2.1/servers/ebd2b19d-ddad-422b-a276-0fb7cbe80753" status: 200 len: 1219 microversion: 2.1 time: 0.464514 Jun 24 16:35:04.725628 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 167/308] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:35:04 2022] GET /compute/v2.1/servers/ebd2b19d-ddad-422b-a276-0fb7cbe80753 => generated 1219 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 16:35:05.115037 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-640638c3-022a-4484-b11a-41cb46844b6f tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Calling method '>' {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:35:05.120000 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-640638c3-022a-4484-b11a-41cb46844b6f tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] [instance: 30b3ffec-7110-4b4d-9482-2451914c166f] Fetching instance by UUID {{(pid=102149) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:35:05.148089 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-640638c3-022a-4484-b11a-41cb46844b6f tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:35:05.149757 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-640638c3-022a-4484-b11a-41cb46844b6f tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:35:05.152484 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-640638c3-022a-4484-b11a-41cb46844b6f tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:35:05.153624 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-640638c3-022a-4484-b11a-41cb46844b6f tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:35:05.653021 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-640638c3-022a-4484-b11a-41cb46844b6f tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7489b29cb3ef47d78dfd55794f338b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065254ebe67545639644fcbc6bd9fc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:35:05.664202 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-640638c3-022a-4484-b11a-41cb46844b6f tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7489b29cb3ef47d78dfd55794f338b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065254ebe67545639644fcbc6bd9fc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:35:05.665772 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-640638c3-022a-4484-b11a-41cb46844b6f tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7489b29cb3ef47d78dfd55794f338b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065254ebe67545639644fcbc6bd9fc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:35:05.668406 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-640638c3-022a-4484-b11a-41cb46844b6f tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] 10.222.0.18 "GET /compute/v2.1/servers/30b3ffec-7110-4b4d-9482-2451914c166f" status: 200 len: 1807 microversion: 2.20 time: 0.561282 Jun 24 16:35:05.669856 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 142/309] 10.222.0.18 () {60 vars in 1276 bytes} [Fri Jun 24 16:35:05 2022] GET /compute/v2.1/servers/30b3ffec-7110-4b4d-9482-2451914c166f => generated 1807 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 16:35:05.703994 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-745c478d-541b-4f75-b956-57e22f9b8f6e tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Calling method '>' {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:35:05.706458 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-745c478d-541b-4f75-b956-57e22f9b8f6e tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] [instance: 2b6c814b-481d-4fba-8cd7-c84aee3f7572] Fetching instance by UUID {{(pid=102148) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:35:05.727863 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-745c478d-541b-4f75-b956-57e22f9b8f6e tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:35:05.730338 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-745c478d-541b-4f75-b956-57e22f9b8f6e tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:35:05.731577 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-745c478d-541b-4f75-b956-57e22f9b8f6e tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:35:05.732915 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-745c478d-541b-4f75-b956-57e22f9b8f6e tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:35:05.752060 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-f4073b07-1ed0-4d62-ac02-399425f56f70 tempest-VolumesSnapshotTestJSON-1294974655 tempest-VolumesSnapshotTestJSON-1294974655-project] Calling method '>' {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:35:05.753514 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-f4073b07-1ed0-4d62-ac02-399425f56f70 tempest-VolumesSnapshotTestJSON-1294974655 tempest-VolumesSnapshotTestJSON-1294974655-project] [instance: ebd2b19d-ddad-422b-a276-0fb7cbe80753] Fetching instance by UUID {{(pid=102149) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:35:05.790039 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-f4073b07-1ed0-4d62-ac02-399425f56f70 tempest-VolumesSnapshotTestJSON-1294974655 tempest-VolumesSnapshotTestJSON-1294974655-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:35:05.790791 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-f4073b07-1ed0-4d62-ac02-399425f56f70 tempest-VolumesSnapshotTestJSON-1294974655 tempest-VolumesSnapshotTestJSON-1294974655-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:35:05.791837 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-f4073b07-1ed0-4d62-ac02-399425f56f70 tempest-VolumesSnapshotTestJSON-1294974655 tempest-VolumesSnapshotTestJSON-1294974655-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:35:05.794618 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-f4073b07-1ed0-4d62-ac02-399425f56f70 tempest-VolumesSnapshotTestJSON-1294974655 tempest-VolumesSnapshotTestJSON-1294974655-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:35:06.074161 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-745c478d-541b-4f75-b956-57e22f9b8f6e tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65d11cab328748d5a8f5e55eb439e334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901fbc33d59d49f8afa7f06d62e19e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:35:06.081798 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-f4073b07-1ed0-4d62-ac02-399425f56f70 tempest-VolumesSnapshotTestJSON-1294974655 tempest-VolumesSnapshotTestJSON-1294974655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7b98bac241449c9a8b14307e4f7993a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0966981b5f4c3fa17c73c0c4b31779', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:35:06.090327 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-745c478d-541b-4f75-b956-57e22f9b8f6e tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] 10.222.0.18 "GET /compute/v2.1/servers/2b6c814b-481d-4fba-8cd7-c84aee3f7572" status: 200 len: 1191 microversion: 2.1 time: 0.395453 Jun 24 16:35:06.091539 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 168/310] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:35:05 2022] GET /compute/v2.1/servers/2b6c814b-481d-4fba-8cd7-c84aee3f7572 => generated 1191 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 16:35:06.091714 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-f4073b07-1ed0-4d62-ac02-399425f56f70 tempest-VolumesSnapshotTestJSON-1294974655 tempest-VolumesSnapshotTestJSON-1294974655-project] 10.222.0.18 "GET /compute/v2.1/servers/ebd2b19d-ddad-422b-a276-0fb7cbe80753" status: 200 len: 1215 microversion: 2.1 time: 0.343390 Jun 24 16:35:06.092232 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 143/311] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:35:05 2022] GET /compute/v2.1/servers/ebd2b19d-ddad-422b-a276-0fb7cbe80753 => generated 1215 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 16:35:06.703931 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-60ac811e-9c41-4600-9ebf-930264337605 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Calling method '>' {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:35:06.705609 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-60ac811e-9c41-4600-9ebf-930264337605 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] [instance: 30b3ffec-7110-4b4d-9482-2451914c166f] Fetching instance by UUID {{(pid=102148) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:35:06.725377 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-60ac811e-9c41-4600-9ebf-930264337605 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:35:06.725898 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-60ac811e-9c41-4600-9ebf-930264337605 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:35:06.726995 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-60ac811e-9c41-4600-9ebf-930264337605 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:35:06.727602 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-60ac811e-9c41-4600-9ebf-930264337605 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:35:07.113251 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-daac1d9d-4da1-45d7-b368-c9d5652ff40f tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Calling method '>' {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:35:07.115481 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-daac1d9d-4da1-45d7-b368-c9d5652ff40f tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] [instance: 2b6c814b-481d-4fba-8cd7-c84aee3f7572] Fetching instance by UUID {{(pid=102149) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:35:07.132183 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-daac1d9d-4da1-45d7-b368-c9d5652ff40f tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:35:07.132949 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-daac1d9d-4da1-45d7-b368-c9d5652ff40f tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:35:07.134514 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-daac1d9d-4da1-45d7-b368-c9d5652ff40f tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:35:07.136435 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-daac1d9d-4da1-45d7-b368-c9d5652ff40f tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:35:07.192587 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-60ac811e-9c41-4600-9ebf-930264337605 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7489b29cb3ef47d78dfd55794f338b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065254ebe67545639644fcbc6bd9fc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:35:07.213738 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-60ac811e-9c41-4600-9ebf-930264337605 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7489b29cb3ef47d78dfd55794f338b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065254ebe67545639644fcbc6bd9fc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:35:07.218078 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-60ac811e-9c41-4600-9ebf-930264337605 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7489b29cb3ef47d78dfd55794f338b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065254ebe67545639644fcbc6bd9fc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:35:07.221151 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-60ac811e-9c41-4600-9ebf-930264337605 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] 10.222.0.18 "GET /compute/v2.1/servers/30b3ffec-7110-4b4d-9482-2451914c166f" status: 200 len: 1807 microversion: 2.20 time: 0.524096 Jun 24 16:35:07.222622 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 169/312] 10.222.0.18 () {60 vars in 1276 bytes} [Fri Jun 24 16:35:06 2022] GET /compute/v2.1/servers/30b3ffec-7110-4b4d-9482-2451914c166f => generated 1807 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 16:35:07.246381 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-97096105-ca33-4955-963d-6ff0ce1b3e1f tempest-VolumesSnapshotTestJSON-1294974655 tempest-VolumesSnapshotTestJSON-1294974655-project] Calling method '>' {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:35:07.251862 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-97096105-ca33-4955-963d-6ff0ce1b3e1f tempest-VolumesSnapshotTestJSON-1294974655 tempest-VolumesSnapshotTestJSON-1294974655-project] [instance: ebd2b19d-ddad-422b-a276-0fb7cbe80753] Fetching instance by UUID {{(pid=102148) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:35:07.266717 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-97096105-ca33-4955-963d-6ff0ce1b3e1f tempest-VolumesSnapshotTestJSON-1294974655 tempest-VolumesSnapshotTestJSON-1294974655-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:35:07.267954 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-97096105-ca33-4955-963d-6ff0ce1b3e1f tempest-VolumesSnapshotTestJSON-1294974655 tempest-VolumesSnapshotTestJSON-1294974655-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:35:07.271338 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-97096105-ca33-4955-963d-6ff0ce1b3e1f tempest-VolumesSnapshotTestJSON-1294974655 tempest-VolumesSnapshotTestJSON-1294974655-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:35:07.273364 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-97096105-ca33-4955-963d-6ff0ce1b3e1f tempest-VolumesSnapshotTestJSON-1294974655 tempest-VolumesSnapshotTestJSON-1294974655-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:35:07.368393 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-daac1d9d-4da1-45d7-b368-c9d5652ff40f tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65d11cab328748d5a8f5e55eb439e334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901fbc33d59d49f8afa7f06d62e19e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:35:07.382289 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-daac1d9d-4da1-45d7-b368-c9d5652ff40f tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] 10.222.0.18 "GET /compute/v2.1/servers/2b6c814b-481d-4fba-8cd7-c84aee3f7572" status: 200 len: 1209 microversion: 2.1 time: 0.275654 Jun 24 16:35:07.388310 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 144/313] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:35:07 2022] GET /compute/v2.1/servers/2b6c814b-481d-4fba-8cd7-c84aee3f7572 => generated 1209 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 16:35:07.770717 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-97096105-ca33-4955-963d-6ff0ce1b3e1f tempest-VolumesSnapshotTestJSON-1294974655 tempest-VolumesSnapshotTestJSON-1294974655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7b98bac241449c9a8b14307e4f7993a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0966981b5f4c3fa17c73c0c4b31779', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:35:07.781895 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-97096105-ca33-4955-963d-6ff0ce1b3e1f tempest-VolumesSnapshotTestJSON-1294974655 tempest-VolumesSnapshotTestJSON-1294974655-project] 10.222.0.18 "GET /compute/v2.1/servers/ebd2b19d-ddad-422b-a276-0fb7cbe80753" status: 200 len: 1279 microversion: 2.1 time: 0.557396 Jun 24 16:35:07.785666 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 170/314] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:35:07 2022] GET /compute/v2.1/servers/ebd2b19d-ddad-422b-a276-0fb7cbe80753 => generated 1279 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 16:35:08.257215 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-5f9788ff-6b81-4318-9d2e-af551a1583fa tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Calling method '>' {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:35:08.259234 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-5f9788ff-6b81-4318-9d2e-af551a1583fa tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] [instance: 30b3ffec-7110-4b4d-9482-2451914c166f] Fetching instance by UUID {{(pid=102149) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:35:08.275774 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-5f9788ff-6b81-4318-9d2e-af551a1583fa tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:35:08.277130 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-5f9788ff-6b81-4318-9d2e-af551a1583fa tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:35:08.278855 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-5f9788ff-6b81-4318-9d2e-af551a1583fa tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:35:08.279850 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-5f9788ff-6b81-4318-9d2e-af551a1583fa tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:35:08.419105 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-02cdd9a5-3d37-46c7-acd3-2c71f566a984 tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Calling method '>' {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:35:08.423606 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-02cdd9a5-3d37-46c7-acd3-2c71f566a984 tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] [instance: 2b6c814b-481d-4fba-8cd7-c84aee3f7572] Fetching instance by UUID {{(pid=102148) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:35:08.449501 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-02cdd9a5-3d37-46c7-acd3-2c71f566a984 tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:35:08.450926 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-02cdd9a5-3d37-46c7-acd3-2c71f566a984 tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:35:08.453425 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-02cdd9a5-3d37-46c7-acd3-2c71f566a984 tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:35:08.455071 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-02cdd9a5-3d37-46c7-acd3-2c71f566a984 tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:35:09.115530 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-5f9788ff-6b81-4318-9d2e-af551a1583fa tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7489b29cb3ef47d78dfd55794f338b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065254ebe67545639644fcbc6bd9fc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:35:09.155639 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-5f9788ff-6b81-4318-9d2e-af551a1583fa tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7489b29cb3ef47d78dfd55794f338b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065254ebe67545639644fcbc6bd9fc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:35:09.158929 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-5f9788ff-6b81-4318-9d2e-af551a1583fa tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7489b29cb3ef47d78dfd55794f338b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065254ebe67545639644fcbc6bd9fc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:35:09.162753 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-5f9788ff-6b81-4318-9d2e-af551a1583fa tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] 10.222.0.18 "GET /compute/v2.1/servers/30b3ffec-7110-4b4d-9482-2451914c166f" status: 200 len: 1807 microversion: 2.20 time: 0.912766 Jun 24 16:35:09.165308 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 145/315] 10.222.0.18 () {60 vars in 1276 bytes} [Fri Jun 24 16:35:08 2022] GET /compute/v2.1/servers/30b3ffec-7110-4b4d-9482-2451914c166f => generated 1807 bytes in 916 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 16:35:09.184098 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-516fdc4f-2e1f-4824-8288-51738c67d090 tempest-VolumesSnapshotTestJSON-1294974655 tempest-VolumesSnapshotTestJSON-1294974655-project] Calling method '>' {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:35:09.185130 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-516fdc4f-2e1f-4824-8288-51738c67d090 tempest-VolumesSnapshotTestJSON-1294974655 tempest-VolumesSnapshotTestJSON-1294974655-project] [instance: ebd2b19d-ddad-422b-a276-0fb7cbe80753] Fetching instance by UUID {{(pid=102149) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:35:09.193742 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-516fdc4f-2e1f-4824-8288-51738c67d090 tempest-VolumesSnapshotTestJSON-1294974655 tempest-VolumesSnapshotTestJSON-1294974655-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:35:09.194447 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-516fdc4f-2e1f-4824-8288-51738c67d090 tempest-VolumesSnapshotTestJSON-1294974655 tempest-VolumesSnapshotTestJSON-1294974655-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:35:09.195542 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-516fdc4f-2e1f-4824-8288-51738c67d090 tempest-VolumesSnapshotTestJSON-1294974655 tempest-VolumesSnapshotTestJSON-1294974655-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:35:09.196137 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-516fdc4f-2e1f-4824-8288-51738c67d090 tempest-VolumesSnapshotTestJSON-1294974655 tempest-VolumesSnapshotTestJSON-1294974655-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:35:09.294127 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-02cdd9a5-3d37-46c7-acd3-2c71f566a984 tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65d11cab328748d5a8f5e55eb439e334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901fbc33d59d49f8afa7f06d62e19e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:35:09.315675 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-02cdd9a5-3d37-46c7-acd3-2c71f566a984 tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] 10.222.0.18 "GET /compute/v2.1/servers/2b6c814b-481d-4fba-8cd7-c84aee3f7572" status: 200 len: 1265 microversion: 2.1 time: 0.904974 Jun 24 16:35:09.316557 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 171/316] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:35:08 2022] GET /compute/v2.1/servers/2b6c814b-481d-4fba-8cd7-c84aee3f7572 => generated 1265 bytes in 908 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 16:35:09.478136 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-516fdc4f-2e1f-4824-8288-51738c67d090 tempest-VolumesSnapshotTestJSON-1294974655 tempest-VolumesSnapshotTestJSON-1294974655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7b98bac241449c9a8b14307e4f7993a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0966981b5f4c3fa17c73c0c4b31779', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:35:09.491651 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-516fdc4f-2e1f-4824-8288-51738c67d090 tempest-VolumesSnapshotTestJSON-1294974655 tempest-VolumesSnapshotTestJSON-1294974655-project] 10.222.0.18 "GET /compute/v2.1/servers/ebd2b19d-ddad-422b-a276-0fb7cbe80753" status: 200 len: 1277 microversion: 2.1 time: 0.319184 Jun 24 16:35:09.503773 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 146/317] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:35:09 2022] GET /compute/v2.1/servers/ebd2b19d-ddad-422b-a276-0fb7cbe80753 => generated 1277 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 16:35:10.194765 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-43df7a56-1774-4bda-b7e0-17ddc77c8d54 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Calling method '>' {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:35:10.195360 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-43df7a56-1774-4bda-b7e0-17ddc77c8d54 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] [instance: 30b3ffec-7110-4b4d-9482-2451914c166f] Fetching instance by UUID {{(pid=102148) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:35:10.208682 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-43df7a56-1774-4bda-b7e0-17ddc77c8d54 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:35:10.209795 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-43df7a56-1774-4bda-b7e0-17ddc77c8d54 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:35:10.211313 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-43df7a56-1774-4bda-b7e0-17ddc77c8d54 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:35:10.212159 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-43df7a56-1774-4bda-b7e0-17ddc77c8d54 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:35:10.313038 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [req-a42f001d-88b9-44bd-bedd-0ac89a9eeaba req-7343e156-43cf-4f6c-a963-2a456a07131c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2b6c814b-481d-4fba-8cd7-c84aee3f7572", "tag": "27aaebe5-51e8-49c2-8f07-e0e78f4459fd"}]} {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 16:35:10.323834 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 24 16:35:10.323834 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: warnings.warn(msg) Jun 24 16:35:10.373321 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [req-a42f001d-88b9-44bd-bedd-0ac89a9eeaba req-7343e156-43cf-4f6c-a963-2a456a07131c service nova] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:35:10.373321 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [req-a42f001d-88b9-44bd-bedd-0ac89a9eeaba req-7343e156-43cf-4f6c-a963-2a456a07131c service nova] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:35:10.439515 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.compute.server_external_events [req-a42f001d-88b9-44bd-bedd-0ac89a9eeaba req-7343e156-43cf-4f6c-a963-2a456a07131c service nova] Creating event network-changed:27aaebe5-51e8-49c2-8f07-e0e78f4459fd for instance 2b6c814b-481d-4fba-8cd7-c84aee3f7572 on hv-cinder-84718 Jun 24 16:35:10.455015 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [req-a42f001d-88b9-44bd-bedd-0ac89a9eeaba req-7343e156-43cf-4f6c-a963-2a456a07131c service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.149555 Jun 24 16:35:10.457793 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 147/318] 10.222.0.18 () {64 vars in 1317 bytes} [Fri Jun 24 16:35:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 16:35:10.468218 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-1fc3d585-2a4c-4cf1-81a2-c28ced0fda07 tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Calling method '>' {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:35:10.469759 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-1fc3d585-2a4c-4cf1-81a2-c28ced0fda07 tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] [instance: 2b6c814b-481d-4fba-8cd7-c84aee3f7572] Fetching instance by UUID {{(pid=102149) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:35:10.497024 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-1fc3d585-2a4c-4cf1-81a2-c28ced0fda07 tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:35:10.518654 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-1fc3d585-2a4c-4cf1-81a2-c28ced0fda07 tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:35:10.520715 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-1fc3d585-2a4c-4cf1-81a2-c28ced0fda07 tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:35:10.521749 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-1fc3d585-2a4c-4cf1-81a2-c28ced0fda07 tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:35:11.233888 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-43df7a56-1774-4bda-b7e0-17ddc77c8d54 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7489b29cb3ef47d78dfd55794f338b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065254ebe67545639644fcbc6bd9fc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:35:11.264248 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-1fc3d585-2a4c-4cf1-81a2-c28ced0fda07 tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65d11cab328748d5a8f5e55eb439e334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901fbc33d59d49f8afa7f06d62e19e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:35:11.269772 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-43df7a56-1774-4bda-b7e0-17ddc77c8d54 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7489b29cb3ef47d78dfd55794f338b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065254ebe67545639644fcbc6bd9fc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:35:11.277746 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-43df7a56-1774-4bda-b7e0-17ddc77c8d54 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7489b29cb3ef47d78dfd55794f338b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065254ebe67545639644fcbc6bd9fc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:35:11.281907 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-43df7a56-1774-4bda-b7e0-17ddc77c8d54 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] 10.222.0.18 "GET /compute/v2.1/servers/30b3ffec-7110-4b4d-9482-2451914c166f" status: 200 len: 1807 microversion: 2.20 time: 1.091142 Jun 24 16:35:11.286337 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 172/319] 10.222.0.18 () {60 vars in 1276 bytes} [Fri Jun 24 16:35:10 2022] GET /compute/v2.1/servers/30b3ffec-7110-4b4d-9482-2451914c166f => generated 1807 bytes in 1096 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 16:35:11.296151 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-1fc3d585-2a4c-4cf1-81a2-c28ced0fda07 tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] 10.222.0.18 "GET /compute/v2.1/servers/2b6c814b-481d-4fba-8cd7-c84aee3f7572" status: 200 len: 1265 microversion: 2.1 time: 0.830524 Jun 24 16:35:11.298666 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 148/320] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:35:10 2022] GET /compute/v2.1/servers/2b6c814b-481d-4fba-8cd7-c84aee3f7572 => generated 1265 bytes in 840 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 16:35:11.300192 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-3df95183-a612-4257-aea9-3bff5e236658 tempest-VolumesSnapshotTestJSON-1294974655 tempest-VolumesSnapshotTestJSON-1294974655-project] Calling method '>' {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:35:11.301807 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-3df95183-a612-4257-aea9-3bff5e236658 tempest-VolumesSnapshotTestJSON-1294974655 tempest-VolumesSnapshotTestJSON-1294974655-project] [instance: ebd2b19d-ddad-422b-a276-0fb7cbe80753] Fetching instance by UUID {{(pid=102148) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:35:11.313153 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-3df95183-a612-4257-aea9-3bff5e236658 tempest-VolumesSnapshotTestJSON-1294974655 tempest-VolumesSnapshotTestJSON-1294974655-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:35:11.313635 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-3df95183-a612-4257-aea9-3bff5e236658 tempest-VolumesSnapshotTestJSON-1294974655 tempest-VolumesSnapshotTestJSON-1294974655-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:35:11.314628 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-3df95183-a612-4257-aea9-3bff5e236658 tempest-VolumesSnapshotTestJSON-1294974655 tempest-VolumesSnapshotTestJSON-1294974655-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:35:11.315101 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-3df95183-a612-4257-aea9-3bff5e236658 tempest-VolumesSnapshotTestJSON-1294974655 tempest-VolumesSnapshotTestJSON-1294974655-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:35:12.206618 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [req-21a2a3c2-abd4-4196-85b1-9fb8a7a2118c req-390bfd9b-6369-4cdc-837b-4bc47f57a7ee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ebd2b19d-ddad-422b-a276-0fb7cbe80753", "tag": "79e89c64-b194-4135-979d-680ac5e90936"}]} {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 16:35:12.211075 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-3df95183-a612-4257-aea9-3bff5e236658 tempest-VolumesSnapshotTestJSON-1294974655 tempest-VolumesSnapshotTestJSON-1294974655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7b98bac241449c9a8b14307e4f7993a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0966981b5f4c3fa17c73c0c4b31779', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:35:12.220886 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 24 16:35:12.220886 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: warnings.warn(msg) Jun 24 16:35:12.223102 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-3df95183-a612-4257-aea9-3bff5e236658 tempest-VolumesSnapshotTestJSON-1294974655 tempest-VolumesSnapshotTestJSON-1294974655-project] 10.222.0.18 "GET /compute/v2.1/servers/ebd2b19d-ddad-422b-a276-0fb7cbe80753" status: 200 len: 1319 microversion: 2.1 time: 0.935300 Jun 24 16:35:12.234847 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 173/321] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:35:11 2022] GET /compute/v2.1/servers/ebd2b19d-ddad-422b-a276-0fb7cbe80753 => generated 1319 bytes in 937 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 16:35:12.257527 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [req-21a2a3c2-abd4-4196-85b1-9fb8a7a2118c req-390bfd9b-6369-4cdc-837b-4bc47f57a7ee service nova] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:35:12.258592 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [req-21a2a3c2-abd4-4196-85b1-9fb8a7a2118c req-390bfd9b-6369-4cdc-837b-4bc47f57a7ee service nova] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:35:12.293526 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.compute.server_external_events [req-21a2a3c2-abd4-4196-85b1-9fb8a7a2118c req-390bfd9b-6369-4cdc-837b-4bc47f57a7ee service nova] Creating event network-changed:79e89c64-b194-4135-979d-680ac5e90936 for instance ebd2b19d-ddad-422b-a276-0fb7cbe80753 on hv-cinder-84718 Jun 24 16:35:12.304679 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [req-21a2a3c2-abd4-4196-85b1-9fb8a7a2118c req-390bfd9b-6369-4cdc-837b-4bc47f57a7ee service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.108224 Jun 24 16:35:12.305795 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 149/322] 10.222.0.18 () {64 vars in 1317 bytes} [Fri Jun 24 16:35:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 16:35:12.320340 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-809993bb-7718-4a2a-9068-24ea95ff9d61 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Calling method '>' {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:35:12.320340 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-809993bb-7718-4a2a-9068-24ea95ff9d61 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] [instance: 30b3ffec-7110-4b4d-9482-2451914c166f] Fetching instance by UUID {{(pid=102148) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:35:12.335123 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-45e5a3a3-acd0-4aed-b05e-9816bcd4cb57 tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Calling method '>' {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:35:12.335543 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-809993bb-7718-4a2a-9068-24ea95ff9d61 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:35:12.336267 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-809993bb-7718-4a2a-9068-24ea95ff9d61 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:35:12.337220 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-45e5a3a3-acd0-4aed-b05e-9816bcd4cb57 tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] [instance: 2b6c814b-481d-4fba-8cd7-c84aee3f7572] Fetching instance by UUID {{(pid=102149) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:35:12.337430 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-809993bb-7718-4a2a-9068-24ea95ff9d61 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:35:12.337908 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-809993bb-7718-4a2a-9068-24ea95ff9d61 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:35:12.355826 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-45e5a3a3-acd0-4aed-b05e-9816bcd4cb57 tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:35:12.357533 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-45e5a3a3-acd0-4aed-b05e-9816bcd4cb57 tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:35:12.359351 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-45e5a3a3-acd0-4aed-b05e-9816bcd4cb57 tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:35:12.360356 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-45e5a3a3-acd0-4aed-b05e-9816bcd4cb57 tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:35:13.091009 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-45e5a3a3-acd0-4aed-b05e-9816bcd4cb57 tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65d11cab328748d5a8f5e55eb439e334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901fbc33d59d49f8afa7f06d62e19e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:35:13.101175 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-45e5a3a3-acd0-4aed-b05e-9816bcd4cb57 tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] 10.222.0.18 "GET /compute/v2.1/servers/2b6c814b-481d-4fba-8cd7-c84aee3f7572" status: 200 len: 1265 microversion: 2.1 time: 0.778319 Jun 24 16:35:13.101756 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-809993bb-7718-4a2a-9068-24ea95ff9d61 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7489b29cb3ef47d78dfd55794f338b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065254ebe67545639644fcbc6bd9fc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:35:13.102177 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 150/323] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:35:12 2022] GET /compute/v2.1/servers/2b6c814b-481d-4fba-8cd7-c84aee3f7572 => generated 1265 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 16:35:13.117308 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-809993bb-7718-4a2a-9068-24ea95ff9d61 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7489b29cb3ef47d78dfd55794f338b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065254ebe67545639644fcbc6bd9fc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:35:13.119067 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-809993bb-7718-4a2a-9068-24ea95ff9d61 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7489b29cb3ef47d78dfd55794f338b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065254ebe67545639644fcbc6bd9fc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:35:13.126932 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-809993bb-7718-4a2a-9068-24ea95ff9d61 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] 10.222.0.18 "GET /compute/v2.1/servers/30b3ffec-7110-4b4d-9482-2451914c166f" status: 200 len: 1807 microversion: 2.20 time: 0.811784 Jun 24 16:35:13.139259 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 174/324] 10.222.0.18 () {60 vars in 1276 bytes} [Fri Jun 24 16:35:12 2022] GET /compute/v2.1/servers/30b3ffec-7110-4b4d-9482-2451914c166f => generated 1807 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 16:35:13.254894 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-43d1ac24-79bc-4b73-8110-ab07e7b8f5d3 tempest-VolumesSnapshotTestJSON-1294974655 tempest-VolumesSnapshotTestJSON-1294974655-project] Calling method '>' {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:35:13.256198 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-43d1ac24-79bc-4b73-8110-ab07e7b8f5d3 tempest-VolumesSnapshotTestJSON-1294974655 tempest-VolumesSnapshotTestJSON-1294974655-project] [instance: ebd2b19d-ddad-422b-a276-0fb7cbe80753] Fetching instance by UUID {{(pid=102149) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:35:13.272263 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-43d1ac24-79bc-4b73-8110-ab07e7b8f5d3 tempest-VolumesSnapshotTestJSON-1294974655 tempest-VolumesSnapshotTestJSON-1294974655-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:35:13.273161 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-43d1ac24-79bc-4b73-8110-ab07e7b8f5d3 tempest-VolumesSnapshotTestJSON-1294974655 tempest-VolumesSnapshotTestJSON-1294974655-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:35:13.274578 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-43d1ac24-79bc-4b73-8110-ab07e7b8f5d3 tempest-VolumesSnapshotTestJSON-1294974655 tempest-VolumesSnapshotTestJSON-1294974655-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:35:13.275329 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-43d1ac24-79bc-4b73-8110-ab07e7b8f5d3 tempest-VolumesSnapshotTestJSON-1294974655 tempest-VolumesSnapshotTestJSON-1294974655-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:35:13.826888 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-43d1ac24-79bc-4b73-8110-ab07e7b8f5d3 tempest-VolumesSnapshotTestJSON-1294974655 tempest-VolumesSnapshotTestJSON-1294974655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7b98bac241449c9a8b14307e4f7993a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0966981b5f4c3fa17c73c0c4b31779', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:35:13.839751 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-43d1ac24-79bc-4b73-8110-ab07e7b8f5d3 tempest-VolumesSnapshotTestJSON-1294974655 tempest-VolumesSnapshotTestJSON-1294974655-project] 10.222.0.18 "GET /compute/v2.1/servers/ebd2b19d-ddad-422b-a276-0fb7cbe80753" status: 200 len: 1319 microversion: 2.1 time: 0.589447 Jun 24 16:35:13.841223 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 151/325] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:35:13 2022] GET /compute/v2.1/servers/ebd2b19d-ddad-422b-a276-0fb7cbe80753 => generated 1319 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 16:35:14.120214 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-bf00084b-2073-4ab3-bd87-59d6e065f936 tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Calling method '>' {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:35:14.121550 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-bf00084b-2073-4ab3-bd87-59d6e065f936 tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] [instance: 2b6c814b-481d-4fba-8cd7-c84aee3f7572] Fetching instance by UUID {{(pid=102148) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:35:14.131471 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-bf00084b-2073-4ab3-bd87-59d6e065f936 tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:35:14.132428 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-bf00084b-2073-4ab3-bd87-59d6e065f936 tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:35:14.133456 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-bf00084b-2073-4ab3-bd87-59d6e065f936 tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:35:14.134079 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-bf00084b-2073-4ab3-bd87-59d6e065f936 tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:35:14.166524 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-5d33411b-5b69-477e-80be-29f0fa3f238a tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Calling method '>' {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:35:14.167531 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-5d33411b-5b69-477e-80be-29f0fa3f238a tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] [instance: 30b3ffec-7110-4b4d-9482-2451914c166f] Fetching instance by UUID {{(pid=102149) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:35:14.179382 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-5d33411b-5b69-477e-80be-29f0fa3f238a tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:35:14.181017 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-5d33411b-5b69-477e-80be-29f0fa3f238a tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:35:14.182796 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-5d33411b-5b69-477e-80be-29f0fa3f238a tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:35:14.185311 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-5d33411b-5b69-477e-80be-29f0fa3f238a tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:35:14.769490 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-bf00084b-2073-4ab3-bd87-59d6e065f936 tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65d11cab328748d5a8f5e55eb439e334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901fbc33d59d49f8afa7f06d62e19e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:35:14.777715 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-5d33411b-5b69-477e-80be-29f0fa3f238a tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7489b29cb3ef47d78dfd55794f338b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065254ebe67545639644fcbc6bd9fc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:35:14.789190 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-bf00084b-2073-4ab3-bd87-59d6e065f936 tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] 10.222.0.18 "GET /compute/v2.1/servers/2b6c814b-481d-4fba-8cd7-c84aee3f7572" status: 200 len: 1265 microversion: 2.1 time: 0.672431 Jun 24 16:35:14.790511 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 175/326] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:35:14 2022] GET /compute/v2.1/servers/2b6c814b-481d-4fba-8cd7-c84aee3f7572 => generated 1265 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 16:35:14.808987 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-5d33411b-5b69-477e-80be-29f0fa3f238a tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7489b29cb3ef47d78dfd55794f338b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065254ebe67545639644fcbc6bd9fc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:35:14.810889 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-5d33411b-5b69-477e-80be-29f0fa3f238a tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7489b29cb3ef47d78dfd55794f338b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065254ebe67545639644fcbc6bd9fc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:35:14.812595 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-5d33411b-5b69-477e-80be-29f0fa3f238a tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] 10.222.0.18 "GET /compute/v2.1/servers/30b3ffec-7110-4b4d-9482-2451914c166f" status: 200 len: 1807 microversion: 2.20 time: 0.649598 Jun 24 16:35:14.813373 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 152/327] 10.222.0.18 () {60 vars in 1276 bytes} [Fri Jun 24 16:35:14 2022] GET /compute/v2.1/servers/30b3ffec-7110-4b4d-9482-2451914c166f => generated 1807 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 16:35:14.857465 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-b31c1d8b-6302-4075-8543-548ac2b86167 tempest-VolumesSnapshotTestJSON-1294974655 tempest-VolumesSnapshotTestJSON-1294974655-project] Calling method '>' {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:35:14.858068 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-b31c1d8b-6302-4075-8543-548ac2b86167 tempest-VolumesSnapshotTestJSON-1294974655 tempest-VolumesSnapshotTestJSON-1294974655-project] [instance: ebd2b19d-ddad-422b-a276-0fb7cbe80753] Fetching instance by UUID {{(pid=102148) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:35:14.866095 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-b31c1d8b-6302-4075-8543-548ac2b86167 tempest-VolumesSnapshotTestJSON-1294974655 tempest-VolumesSnapshotTestJSON-1294974655-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:35:14.866538 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-b31c1d8b-6302-4075-8543-548ac2b86167 tempest-VolumesSnapshotTestJSON-1294974655 tempest-VolumesSnapshotTestJSON-1294974655-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:35:14.867381 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-b31c1d8b-6302-4075-8543-548ac2b86167 tempest-VolumesSnapshotTestJSON-1294974655 tempest-VolumesSnapshotTestJSON-1294974655-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:35:14.867810 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-b31c1d8b-6302-4075-8543-548ac2b86167 tempest-VolumesSnapshotTestJSON-1294974655 tempest-VolumesSnapshotTestJSON-1294974655-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:35:15.193048 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-b31c1d8b-6302-4075-8543-548ac2b86167 tempest-VolumesSnapshotTestJSON-1294974655 tempest-VolumesSnapshotTestJSON-1294974655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7b98bac241449c9a8b14307e4f7993a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0966981b5f4c3fa17c73c0c4b31779', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:35:15.207358 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-b31c1d8b-6302-4075-8543-548ac2b86167 tempest-VolumesSnapshotTestJSON-1294974655 tempest-VolumesSnapshotTestJSON-1294974655-project] 10.222.0.18 "GET /compute/v2.1/servers/ebd2b19d-ddad-422b-a276-0fb7cbe80753" status: 200 len: 1319 microversion: 2.1 time: 0.353684 Jun 24 16:35:15.208992 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 176/328] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:35:14 2022] GET /compute/v2.1/servers/ebd2b19d-ddad-422b-a276-0fb7cbe80753 => generated 1319 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 16:35:15.815346 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-fb18702c-c42f-4ac8-bd08-f35da9517467 tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Calling method '>' {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:35:15.816240 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-fb18702c-c42f-4ac8-bd08-f35da9517467 tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] [instance: 2b6c814b-481d-4fba-8cd7-c84aee3f7572] Fetching instance by UUID {{(pid=102149) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:35:15.823936 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-fb18702c-c42f-4ac8-bd08-f35da9517467 tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:35:15.824645 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-fb18702c-c42f-4ac8-bd08-f35da9517467 tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:35:15.825586 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-fb18702c-c42f-4ac8-bd08-f35da9517467 tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:35:15.826175 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-fb18702c-c42f-4ac8-bd08-f35da9517467 tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:35:15.841156 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-74b3f921-0d3d-492a-a902-7c3a0e2084f8 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Calling method '>' {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:35:15.842782 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-74b3f921-0d3d-492a-a902-7c3a0e2084f8 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] [instance: 30b3ffec-7110-4b4d-9482-2451914c166f] Fetching instance by UUID {{(pid=102148) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:35:15.852226 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-74b3f921-0d3d-492a-a902-7c3a0e2084f8 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:35:15.852931 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-74b3f921-0d3d-492a-a902-7c3a0e2084f8 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:35:15.853870 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-74b3f921-0d3d-492a-a902-7c3a0e2084f8 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:35:15.855036 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-74b3f921-0d3d-492a-a902-7c3a0e2084f8 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:35:16.412663 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-fb18702c-c42f-4ac8-bd08-f35da9517467 tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65d11cab328748d5a8f5e55eb439e334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901fbc33d59d49f8afa7f06d62e19e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:35:16.427616 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-74b3f921-0d3d-492a-a902-7c3a0e2084f8 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7489b29cb3ef47d78dfd55794f338b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065254ebe67545639644fcbc6bd9fc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:35:16.429420 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-fb18702c-c42f-4ac8-bd08-f35da9517467 tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] 10.222.0.18 "GET /compute/v2.1/servers/2b6c814b-481d-4fba-8cd7-c84aee3f7572" status: 200 len: 1265 microversion: 2.1 time: 0.617212 Jun 24 16:35:16.444156 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 153/329] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:35:15 2022] GET /compute/v2.1/servers/2b6c814b-481d-4fba-8cd7-c84aee3f7572 => generated 1265 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 16:35:16.449960 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-74b3f921-0d3d-492a-a902-7c3a0e2084f8 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7489b29cb3ef47d78dfd55794f338b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065254ebe67545639644fcbc6bd9fc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:35:16.454648 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-74b3f921-0d3d-492a-a902-7c3a0e2084f8 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7489b29cb3ef47d78dfd55794f338b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065254ebe67545639644fcbc6bd9fc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:35:16.458510 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-74b3f921-0d3d-492a-a902-7c3a0e2084f8 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] 10.222.0.18 "GET /compute/v2.1/servers/30b3ffec-7110-4b4d-9482-2451914c166f" status: 200 len: 1807 microversion: 2.20 time: 0.621941 Jun 24 16:35:16.458762 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-93f4e6ee-dd9e-4e27-95da-30a72384d7b8 tempest-VolumesSnapshotTestJSON-1294974655 tempest-VolumesSnapshotTestJSON-1294974655-project] Calling method '>' {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:35:16.460623 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 177/330] 10.222.0.18 () {60 vars in 1276 bytes} [Fri Jun 24 16:35:15 2022] GET /compute/v2.1/servers/30b3ffec-7110-4b4d-9482-2451914c166f => generated 1807 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 16:35:16.461236 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-93f4e6ee-dd9e-4e27-95da-30a72384d7b8 tempest-VolumesSnapshotTestJSON-1294974655 tempest-VolumesSnapshotTestJSON-1294974655-project] [instance: ebd2b19d-ddad-422b-a276-0fb7cbe80753] Fetching instance by UUID {{(pid=102149) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:35:16.472932 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-93f4e6ee-dd9e-4e27-95da-30a72384d7b8 tempest-VolumesSnapshotTestJSON-1294974655 tempest-VolumesSnapshotTestJSON-1294974655-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:35:16.473609 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-93f4e6ee-dd9e-4e27-95da-30a72384d7b8 tempest-VolumesSnapshotTestJSON-1294974655 tempest-VolumesSnapshotTestJSON-1294974655-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:35:16.474767 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-93f4e6ee-dd9e-4e27-95da-30a72384d7b8 tempest-VolumesSnapshotTestJSON-1294974655 tempest-VolumesSnapshotTestJSON-1294974655-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:35:16.475465 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-93f4e6ee-dd9e-4e27-95da-30a72384d7b8 tempest-VolumesSnapshotTestJSON-1294974655 tempest-VolumesSnapshotTestJSON-1294974655-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:35:16.636660 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: ERROR oslo.messaging._drivers.impl_rabbit [-] [673dd0e5-3497-471f-a170-54c432bef5aa] AMQP server on 10.222.0.18:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jun 24 16:35:16.747789 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-93f4e6ee-dd9e-4e27-95da-30a72384d7b8 tempest-VolumesSnapshotTestJSON-1294974655 tempest-VolumesSnapshotTestJSON-1294974655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7b98bac241449c9a8b14307e4f7993a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0966981b5f4c3fa17c73c0c4b31779', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:35:16.759726 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-93f4e6ee-dd9e-4e27-95da-30a72384d7b8 tempest-VolumesSnapshotTestJSON-1294974655 tempest-VolumesSnapshotTestJSON-1294974655-project] 10.222.0.18 "GET /compute/v2.1/servers/ebd2b19d-ddad-422b-a276-0fb7cbe80753" status: 200 len: 1319 microversion: 2.1 time: 0.313699 Jun 24 16:35:16.761256 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 154/331] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:35:16 2022] GET /compute/v2.1/servers/ebd2b19d-ddad-422b-a276-0fb7cbe80753 => generated 1319 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 16:35:17.462285 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-8d6c0a08-eb36-400d-a302-e45474ca47b4 tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Calling method '>' {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:35:17.464116 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-8d6c0a08-eb36-400d-a302-e45474ca47b4 tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] [instance: 2b6c814b-481d-4fba-8cd7-c84aee3f7572] Fetching instance by UUID {{(pid=102148) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:35:17.472957 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-8d6c0a08-eb36-400d-a302-e45474ca47b4 tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:35:17.473934 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-8d6c0a08-eb36-400d-a302-e45474ca47b4 tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:35:17.475901 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-8d6c0a08-eb36-400d-a302-e45474ca47b4 tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:35:17.477061 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-8d6c0a08-eb36-400d-a302-e45474ca47b4 tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:35:17.485863 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-eaf25a21-2da9-4bb3-a4bb-fe7873f17660 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Calling method '>' {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:35:17.488571 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-eaf25a21-2da9-4bb3-a4bb-fe7873f17660 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] [instance: 30b3ffec-7110-4b4d-9482-2451914c166f] Fetching instance by UUID {{(pid=102149) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:35:17.503951 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-eaf25a21-2da9-4bb3-a4bb-fe7873f17660 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:35:17.504497 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-eaf25a21-2da9-4bb3-a4bb-fe7873f17660 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:35:17.505498 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-eaf25a21-2da9-4bb3-a4bb-fe7873f17660 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:35:17.506127 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-eaf25a21-2da9-4bb3-a4bb-fe7873f17660 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:35:17.659989 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO oslo.messaging._drivers.impl_rabbit [-] [673dd0e5-3497-471f-a170-54c432bef5aa] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 53948. Jun 24 16:35:17.937890 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-8d6c0a08-eb36-400d-a302-e45474ca47b4 tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65d11cab328748d5a8f5e55eb439e334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901fbc33d59d49f8afa7f06d62e19e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:35:17.946366 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-eaf25a21-2da9-4bb3-a4bb-fe7873f17660 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7489b29cb3ef47d78dfd55794f338b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065254ebe67545639644fcbc6bd9fc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:35:17.951932 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-8d6c0a08-eb36-400d-a302-e45474ca47b4 tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] 10.222.0.18 "GET /compute/v2.1/servers/2b6c814b-481d-4fba-8cd7-c84aee3f7572" status: 200 len: 1265 microversion: 2.1 time: 0.496709 Jun 24 16:35:17.953229 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 178/332] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:35:17 2022] GET /compute/v2.1/servers/2b6c814b-481d-4fba-8cd7-c84aee3f7572 => generated 1265 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 16:35:17.961065 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [req-d3dd753c-bdc8-4df3-a39e-0ebb2863bd56 req-6d8abd8f-d8fd-4f9b-8819-ff73b1a9535b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "30b3ffec-7110-4b4d-9482-2451914c166f", "name": "network-vif-plugged", "status": "completed", "tag": "78a4e31b-a598-4436-bdeb-0904cefd7b6e"}]} {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 16:35:17.964686 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 24 16:35:17.964686 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: warnings.warn(msg) Jun 24 16:35:17.971306 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-eaf25a21-2da9-4bb3-a4bb-fe7873f17660 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7489b29cb3ef47d78dfd55794f338b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065254ebe67545639644fcbc6bd9fc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:35:17.973890 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-eaf25a21-2da9-4bb3-a4bb-fe7873f17660 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7489b29cb3ef47d78dfd55794f338b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065254ebe67545639644fcbc6bd9fc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:35:17.979500 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [req-d3dd753c-bdc8-4df3-a39e-0ebb2863bd56 req-6d8abd8f-d8fd-4f9b-8819-ff73b1a9535b service nova] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:35:17.980164 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [req-d3dd753c-bdc8-4df3-a39e-0ebb2863bd56 req-6d8abd8f-d8fd-4f9b-8819-ff73b1a9535b service nova] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:35:17.988924 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-eaf25a21-2da9-4bb3-a4bb-fe7873f17660 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] 10.222.0.18 "GET /compute/v2.1/servers/30b3ffec-7110-4b4d-9482-2451914c166f" status: 200 len: 1807 microversion: 2.20 time: 0.511625 Jun 24 16:35:17.989932 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 155/333] 10.222.0.18 () {60 vars in 1276 bytes} [Fri Jun 24 16:35:17 2022] GET /compute/v2.1/servers/30b3ffec-7110-4b4d-9482-2451914c166f => generated 1807 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 16:35:18.000086 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-b357299f-ca08-49ca-b57a-f40077ced263 tempest-VolumesSnapshotTestJSON-1294974655 tempest-VolumesSnapshotTestJSON-1294974655-project] Calling method '>' {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:35:18.001441 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-b357299f-ca08-49ca-b57a-f40077ced263 tempest-VolumesSnapshotTestJSON-1294974655 tempest-VolumesSnapshotTestJSON-1294974655-project] [instance: ebd2b19d-ddad-422b-a276-0fb7cbe80753] Fetching instance by UUID {{(pid=102149) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:35:18.008982 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.compute.server_external_events [req-d3dd753c-bdc8-4df3-a39e-0ebb2863bd56 req-6d8abd8f-d8fd-4f9b-8819-ff73b1a9535b service nova] Creating event network-vif-plugged:78a4e31b-a598-4436-bdeb-0904cefd7b6e for instance 30b3ffec-7110-4b4d-9482-2451914c166f on hv-cinder-84718 Jun 24 16:35:18.014149 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-b357299f-ca08-49ca-b57a-f40077ced263 tempest-VolumesSnapshotTestJSON-1294974655 tempest-VolumesSnapshotTestJSON-1294974655-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:35:18.014626 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [req-d3dd753c-bdc8-4df3-a39e-0ebb2863bd56 req-6d8abd8f-d8fd-4f9b-8819-ff73b1a9535b service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059973 Jun 24 16:35:18.014953 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-b357299f-ca08-49ca-b57a-f40077ced263 tempest-VolumesSnapshotTestJSON-1294974655 tempest-VolumesSnapshotTestJSON-1294974655-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:35:18.015479 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 179/334] 10.222.0.18 () {64 vars in 1317 bytes} [Fri Jun 24 16:35:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 16:35:18.016549 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-b357299f-ca08-49ca-b57a-f40077ced263 tempest-VolumesSnapshotTestJSON-1294974655 tempest-VolumesSnapshotTestJSON-1294974655-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:35:18.017132 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-b357299f-ca08-49ca-b57a-f40077ced263 tempest-VolumesSnapshotTestJSON-1294974655 tempest-VolumesSnapshotTestJSON-1294974655-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:35:18.306388 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-b357299f-ca08-49ca-b57a-f40077ced263 tempest-VolumesSnapshotTestJSON-1294974655 tempest-VolumesSnapshotTestJSON-1294974655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7b98bac241449c9a8b14307e4f7993a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0966981b5f4c3fa17c73c0c4b31779', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:35:18.321331 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-b357299f-ca08-49ca-b57a-f40077ced263 tempest-VolumesSnapshotTestJSON-1294974655 tempest-VolumesSnapshotTestJSON-1294974655-project] 10.222.0.18 "GET /compute/v2.1/servers/ebd2b19d-ddad-422b-a276-0fb7cbe80753" status: 200 len: 1319 microversion: 2.1 time: 0.329295 Jun 24 16:35:18.323447 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 156/335] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:35:17 2022] GET /compute/v2.1/servers/ebd2b19d-ddad-422b-a276-0fb7cbe80753 => generated 1319 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 16:35:18.974117 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-db5684f6-8eb0-48d3-b36b-ab63eed06a57 tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Calling method '>' {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:35:18.975257 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-db5684f6-8eb0-48d3-b36b-ab63eed06a57 tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] [instance: 2b6c814b-481d-4fba-8cd7-c84aee3f7572] Fetching instance by UUID {{(pid=102148) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:35:18.987930 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-db5684f6-8eb0-48d3-b36b-ab63eed06a57 tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:35:18.988576 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-db5684f6-8eb0-48d3-b36b-ab63eed06a57 tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:35:18.989945 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-db5684f6-8eb0-48d3-b36b-ab63eed06a57 tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:35:18.990719 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-db5684f6-8eb0-48d3-b36b-ab63eed06a57 tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:35:19.008227 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-67094fbc-966c-4816-aeed-5ca2b3d22d90 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Calling method '>' {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:35:19.009196 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-67094fbc-966c-4816-aeed-5ca2b3d22d90 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] [instance: 30b3ffec-7110-4b4d-9482-2451914c166f] Fetching instance by UUID {{(pid=102149) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:35:19.018163 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-67094fbc-966c-4816-aeed-5ca2b3d22d90 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:35:19.018657 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-67094fbc-966c-4816-aeed-5ca2b3d22d90 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:35:19.019907 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-67094fbc-966c-4816-aeed-5ca2b3d22d90 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:35:19.020818 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-67094fbc-966c-4816-aeed-5ca2b3d22d90 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:35:19.420821 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-67094fbc-966c-4816-aeed-5ca2b3d22d90 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7489b29cb3ef47d78dfd55794f338b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065254ebe67545639644fcbc6bd9fc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:35:19.426335 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-db5684f6-8eb0-48d3-b36b-ab63eed06a57 tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65d11cab328748d5a8f5e55eb439e334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901fbc33d59d49f8afa7f06d62e19e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:35:19.434302 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-67094fbc-966c-4816-aeed-5ca2b3d22d90 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7489b29cb3ef47d78dfd55794f338b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065254ebe67545639644fcbc6bd9fc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:35:19.437070 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-67094fbc-966c-4816-aeed-5ca2b3d22d90 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7489b29cb3ef47d78dfd55794f338b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065254ebe67545639644fcbc6bd9fc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:35:19.438392 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-67094fbc-966c-4816-aeed-5ca2b3d22d90 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] 10.222.0.18 "GET /compute/v2.1/servers/30b3ffec-7110-4b4d-9482-2451914c166f" status: 200 len: 1807 microversion: 2.20 time: 0.433831 Jun 24 16:35:19.439589 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 157/336] 10.222.0.18 () {60 vars in 1276 bytes} [Fri Jun 24 16:35:19 2022] GET /compute/v2.1/servers/30b3ffec-7110-4b4d-9482-2451914c166f => generated 1807 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 16:35:19.441430 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-db5684f6-8eb0-48d3-b36b-ab63eed06a57 tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] 10.222.0.18 "GET /compute/v2.1/servers/2b6c814b-481d-4fba-8cd7-c84aee3f7572" status: 200 len: 1265 microversion: 2.1 time: 0.474290 Jun 24 16:35:19.442729 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 180/337] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:35:18 2022] GET /compute/v2.1/servers/2b6c814b-481d-4fba-8cd7-c84aee3f7572 => generated 1265 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 16:35:19.444940 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-f6298070-0673-4410-b029-ab4cbdc3abc8 tempest-VolumesSnapshotTestJSON-1294974655 tempest-VolumesSnapshotTestJSON-1294974655-project] Calling method '>' {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:35:19.445537 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-f6298070-0673-4410-b029-ab4cbdc3abc8 tempest-VolumesSnapshotTestJSON-1294974655 tempest-VolumesSnapshotTestJSON-1294974655-project] [instance: ebd2b19d-ddad-422b-a276-0fb7cbe80753] Fetching instance by UUID {{(pid=102149) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:35:19.454332 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-f6298070-0673-4410-b029-ab4cbdc3abc8 tempest-VolumesSnapshotTestJSON-1294974655 tempest-VolumesSnapshotTestJSON-1294974655-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:35:19.455186 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-f6298070-0673-4410-b029-ab4cbdc3abc8 tempest-VolumesSnapshotTestJSON-1294974655 tempest-VolumesSnapshotTestJSON-1294974655-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:35:19.456438 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-f6298070-0673-4410-b029-ab4cbdc3abc8 tempest-VolumesSnapshotTestJSON-1294974655 tempest-VolumesSnapshotTestJSON-1294974655-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:35:19.457045 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-f6298070-0673-4410-b029-ab4cbdc3abc8 tempest-VolumesSnapshotTestJSON-1294974655 tempest-VolumesSnapshotTestJSON-1294974655-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:35:19.738567 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-f6298070-0673-4410-b029-ab4cbdc3abc8 tempest-VolumesSnapshotTestJSON-1294974655 tempest-VolumesSnapshotTestJSON-1294974655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7b98bac241449c9a8b14307e4f7993a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0966981b5f4c3fa17c73c0c4b31779', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:35:19.749413 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-f6298070-0673-4410-b029-ab4cbdc3abc8 tempest-VolumesSnapshotTestJSON-1294974655 tempest-VolumesSnapshotTestJSON-1294974655-project] 10.222.0.18 "GET /compute/v2.1/servers/ebd2b19d-ddad-422b-a276-0fb7cbe80753" status: 200 len: 1319 microversion: 2.1 time: 0.308503 Jun 24 16:35:19.750364 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 158/338] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:35:19 2022] GET /compute/v2.1/servers/ebd2b19d-ddad-422b-a276-0fb7cbe80753 => generated 1319 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 16:35:19.909108 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-acde62ca-5a3a-488f-938f-d1734957b30c tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5f9484b2-a8b8-44e8-9f61-276808d424fa"}} {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 16:35:19.910971 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-acde62ca-5a3a-488f-938f-d1734957b30c tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] [instance: 1739cd84-3709-4cf4-95e3-82de4b4d3d7a] Fetching instance by UUID {{(pid=102148) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:35:19.922813 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-acde62ca-5a3a-488f-938f-d1734957b30c tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:35:19.923264 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-acde62ca-5a3a-488f-938f-d1734957b30c tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:35:19.924058 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-acde62ca-5a3a-488f-938f-d1734957b30c tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:35:19.924491 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-acde62ca-5a3a-488f-938f-d1734957b30c tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:35:20.368155 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-acde62ca-5a3a-488f-938f-d1734957b30c tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] 10.222.0.18 "POST /compute/v2.1/servers/1739cd84-3709-4cf4-95e3-82de4b4d3d7a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.462967 Jun 24 16:35:20.369246 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 181/339] 10.222.0.18 () {60 vars in 1322 bytes} [Fri Jun 24 16:35:19 2022] POST /compute/v2.1/servers/1739cd84-3709-4cf4-95e3-82de4b4d3d7a/os-volume_attachments => generated 194 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 16:35:20.473602 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-94d9356a-fadd-4f67-8d70-70baa964a452 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Calling method '>' {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:35:20.474974 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-0c8412c2-b4bf-493c-8bcc-7e38c901ae69 tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Calling method '>' {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:35:20.476923 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-94d9356a-fadd-4f67-8d70-70baa964a452 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] [instance: 30b3ffec-7110-4b4d-9482-2451914c166f] Fetching instance by UUID {{(pid=102149) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:35:20.478544 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-0c8412c2-b4bf-493c-8bcc-7e38c901ae69 tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] [instance: 2b6c814b-481d-4fba-8cd7-c84aee3f7572] Fetching instance by UUID {{(pid=102148) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:35:20.495008 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-94d9356a-fadd-4f67-8d70-70baa964a452 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:35:20.497367 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-94d9356a-fadd-4f67-8d70-70baa964a452 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:35:20.498277 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-94d9356a-fadd-4f67-8d70-70baa964a452 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:35:20.499307 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-0c8412c2-b4bf-493c-8bcc-7e38c901ae69 tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:35:20.499720 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-94d9356a-fadd-4f67-8d70-70baa964a452 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:35:20.500347 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-0c8412c2-b4bf-493c-8bcc-7e38c901ae69 tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:35:20.503953 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-0c8412c2-b4bf-493c-8bcc-7e38c901ae69 tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:35:20.504493 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-0c8412c2-b4bf-493c-8bcc-7e38c901ae69 tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:35:20.911479 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-0c8412c2-b4bf-493c-8bcc-7e38c901ae69 tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65d11cab328748d5a8f5e55eb439e334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901fbc33d59d49f8afa7f06d62e19e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:35:20.912107 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-94d9356a-fadd-4f67-8d70-70baa964a452 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7489b29cb3ef47d78dfd55794f338b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065254ebe67545639644fcbc6bd9fc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:35:20.929157 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-94d9356a-fadd-4f67-8d70-70baa964a452 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7489b29cb3ef47d78dfd55794f338b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065254ebe67545639644fcbc6bd9fc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:35:20.932411 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-0c8412c2-b4bf-493c-8bcc-7e38c901ae69 tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] 10.222.0.18 "GET /compute/v2.1/servers/2b6c814b-481d-4fba-8cd7-c84aee3f7572" status: 200 len: 1265 microversion: 2.1 time: 0.467265 Jun 24 16:35:20.933272 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-94d9356a-fadd-4f67-8d70-70baa964a452 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7489b29cb3ef47d78dfd55794f338b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065254ebe67545639644fcbc6bd9fc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:35:20.933678 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 182/340] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:35:20 2022] GET /compute/v2.1/servers/2b6c814b-481d-4fba-8cd7-c84aee3f7572 => generated 1265 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 16:35:20.943517 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-4d875d09-5ca8-4029-b556-5270644cbb2b tempest-VolumesSnapshotTestJSON-1294974655 tempest-VolumesSnapshotTestJSON-1294974655-project] Calling method '>' {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:35:20.945124 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-94d9356a-fadd-4f67-8d70-70baa964a452 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] 10.222.0.18 "GET /compute/v2.1/servers/30b3ffec-7110-4b4d-9482-2451914c166f" status: 200 len: 1807 microversion: 2.20 time: 0.482707 Jun 24 16:35:20.945724 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-4d875d09-5ca8-4029-b556-5270644cbb2b tempest-VolumesSnapshotTestJSON-1294974655 tempest-VolumesSnapshotTestJSON-1294974655-project] [instance: ebd2b19d-ddad-422b-a276-0fb7cbe80753] Fetching instance by UUID {{(pid=102148) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:35:20.946061 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 159/341] 10.222.0.18 () {60 vars in 1276 bytes} [Fri Jun 24 16:35:20 2022] GET /compute/v2.1/servers/30b3ffec-7110-4b4d-9482-2451914c166f => generated 1807 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 16:35:20.962941 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-4d875d09-5ca8-4029-b556-5270644cbb2b tempest-VolumesSnapshotTestJSON-1294974655 tempest-VolumesSnapshotTestJSON-1294974655-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:35:20.964281 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-4d875d09-5ca8-4029-b556-5270644cbb2b tempest-VolumesSnapshotTestJSON-1294974655 tempest-VolumesSnapshotTestJSON-1294974655-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:35:20.965857 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-4d875d09-5ca8-4029-b556-5270644cbb2b tempest-VolumesSnapshotTestJSON-1294974655 tempest-VolumesSnapshotTestJSON-1294974655-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:35:20.966744 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-4d875d09-5ca8-4029-b556-5270644cbb2b tempest-VolumesSnapshotTestJSON-1294974655 tempest-VolumesSnapshotTestJSON-1294974655-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:35:21.291397 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-4d875d09-5ca8-4029-b556-5270644cbb2b tempest-VolumesSnapshotTestJSON-1294974655 tempest-VolumesSnapshotTestJSON-1294974655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7b98bac241449c9a8b14307e4f7993a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0966981b5f4c3fa17c73c0c4b31779', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:35:21.312658 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-4d875d09-5ca8-4029-b556-5270644cbb2b tempest-VolumesSnapshotTestJSON-1294974655 tempest-VolumesSnapshotTestJSON-1294974655-project] 10.222.0.18 "GET /compute/v2.1/servers/ebd2b19d-ddad-422b-a276-0fb7cbe80753" status: 200 len: 1319 microversion: 2.1 time: 0.375004 Jun 24 16:35:21.314155 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 183/342] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:35:20 2022] GET /compute/v2.1/servers/ebd2b19d-ddad-422b-a276-0fb7cbe80753 => generated 1319 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 16:35:21.963014 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-933c9314-1712-4324-8cc0-02ef2cb5095b tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Calling method '>' {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:35:21.965671 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [req-113f6f00-4ebc-4d61-a3d5-bce95bdc2b28 req-04c49a1a-abb7-4765-857c-e8d0fc1b0ee6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ebd2b19d-ddad-422b-a276-0fb7cbe80753", "name": "network-vif-plugged", "status": "completed", "tag": "79e89c64-b194-4135-979d-680ac5e90936"}]} {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 16:35:21.970194 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-933c9314-1712-4324-8cc0-02ef2cb5095b tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] [instance: 2b6c814b-481d-4fba-8cd7-c84aee3f7572] Fetching instance by UUID {{(pid=102148) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:35:21.976432 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 24 16:35:21.976432 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: warnings.warn(msg) Jun 24 16:35:21.992006 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-933c9314-1712-4324-8cc0-02ef2cb5095b tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:35:21.992473 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-933c9314-1712-4324-8cc0-02ef2cb5095b tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:35:21.993271 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-933c9314-1712-4324-8cc0-02ef2cb5095b tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:35:21.993703 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-933c9314-1712-4324-8cc0-02ef2cb5095b tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:35:21.997185 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [req-113f6f00-4ebc-4d61-a3d5-bce95bdc2b28 req-04c49a1a-abb7-4765-857c-e8d0fc1b0ee6 service nova] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:35:22.000488 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [req-113f6f00-4ebc-4d61-a3d5-bce95bdc2b28 req-04c49a1a-abb7-4765-857c-e8d0fc1b0ee6 service nova] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:35:22.034739 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.compute.server_external_events [req-113f6f00-4ebc-4d61-a3d5-bce95bdc2b28 req-04c49a1a-abb7-4765-857c-e8d0fc1b0ee6 service nova] Creating event network-vif-plugged:79e89c64-b194-4135-979d-680ac5e90936 for instance ebd2b19d-ddad-422b-a276-0fb7cbe80753 on hv-cinder-84718 Jun 24 16:35:22.043546 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [req-113f6f00-4ebc-4d61-a3d5-bce95bdc2b28 req-04c49a1a-abb7-4765-857c-e8d0fc1b0ee6 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103826 Jun 24 16:35:22.044543 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 160/343] 10.222.0.18 () {64 vars in 1317 bytes} [Fri Jun 24 16:35:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 16:35:22.054424 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-3efaf0ae-3b17-4e8b-a72e-effb8d699d5d tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Calling method '>' {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:35:22.055542 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-3efaf0ae-3b17-4e8b-a72e-effb8d699d5d tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] [instance: 30b3ffec-7110-4b4d-9482-2451914c166f] Fetching instance by UUID {{(pid=102149) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:35:22.072147 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-3efaf0ae-3b17-4e8b-a72e-effb8d699d5d tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:35:22.073286 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-3efaf0ae-3b17-4e8b-a72e-effb8d699d5d tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:35:22.074749 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-3efaf0ae-3b17-4e8b-a72e-effb8d699d5d tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:35:22.075480 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-3efaf0ae-3b17-4e8b-a72e-effb8d699d5d tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:35:22.548129 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-933c9314-1712-4324-8cc0-02ef2cb5095b tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65d11cab328748d5a8f5e55eb439e334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901fbc33d59d49f8afa7f06d62e19e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:35:22.573515 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-933c9314-1712-4324-8cc0-02ef2cb5095b tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] 10.222.0.18 "GET /compute/v2.1/servers/2b6c814b-481d-4fba-8cd7-c84aee3f7572" status: 200 len: 1265 microversion: 2.1 time: 0.623104 Jun 24 16:35:22.575180 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 184/344] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:35:21 2022] GET /compute/v2.1/servers/2b6c814b-481d-4fba-8cd7-c84aee3f7572 => generated 1265 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 16:35:22.584141 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-9c0984ea-5ccc-447f-87b6-df1e07cc8bfd tempest-VolumesSnapshotTestJSON-1294974655 tempest-VolumesSnapshotTestJSON-1294974655-project] Calling method '>' {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:35:22.585464 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-9c0984ea-5ccc-447f-87b6-df1e07cc8bfd tempest-VolumesSnapshotTestJSON-1294974655 tempest-VolumesSnapshotTestJSON-1294974655-project] [instance: ebd2b19d-ddad-422b-a276-0fb7cbe80753] Fetching instance by UUID {{(pid=102148) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:35:22.604032 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-9c0984ea-5ccc-447f-87b6-df1e07cc8bfd tempest-VolumesSnapshotTestJSON-1294974655 tempest-VolumesSnapshotTestJSON-1294974655-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:35:22.605184 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-9c0984ea-5ccc-447f-87b6-df1e07cc8bfd tempest-VolumesSnapshotTestJSON-1294974655 tempest-VolumesSnapshotTestJSON-1294974655-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:35:22.606856 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-9c0984ea-5ccc-447f-87b6-df1e07cc8bfd tempest-VolumesSnapshotTestJSON-1294974655 tempest-VolumesSnapshotTestJSON-1294974655-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:35:22.609209 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-9c0984ea-5ccc-447f-87b6-df1e07cc8bfd tempest-VolumesSnapshotTestJSON-1294974655 tempest-VolumesSnapshotTestJSON-1294974655-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:35:22.887919 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-3efaf0ae-3b17-4e8b-a72e-effb8d699d5d tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7489b29cb3ef47d78dfd55794f338b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065254ebe67545639644fcbc6bd9fc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:35:22.908043 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-3efaf0ae-3b17-4e8b-a72e-effb8d699d5d tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7489b29cb3ef47d78dfd55794f338b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065254ebe67545639644fcbc6bd9fc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:35:22.911607 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-3efaf0ae-3b17-4e8b-a72e-effb8d699d5d tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7489b29cb3ef47d78dfd55794f338b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065254ebe67545639644fcbc6bd9fc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:35:22.914049 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-3efaf0ae-3b17-4e8b-a72e-effb8d699d5d tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] 10.222.0.18 "GET /compute/v2.1/servers/30b3ffec-7110-4b4d-9482-2451914c166f" status: 200 len: 1794 microversion: 2.20 time: 0.867622 Jun 24 16:35:22.915756 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 161/345] 10.222.0.18 () {60 vars in 1276 bytes} [Fri Jun 24 16:35:22 2022] GET /compute/v2.1/servers/30b3ffec-7110-4b4d-9482-2451914c166f => generated 1794 bytes in 871 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 16:35:23.099724 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-9c0984ea-5ccc-447f-87b6-df1e07cc8bfd tempest-VolumesSnapshotTestJSON-1294974655 tempest-VolumesSnapshotTestJSON-1294974655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7b98bac241449c9a8b14307e4f7993a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0966981b5f4c3fa17c73c0c4b31779', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:35:23.115440 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-9c0984ea-5ccc-447f-87b6-df1e07cc8bfd tempest-VolumesSnapshotTestJSON-1294974655 tempest-VolumesSnapshotTestJSON-1294974655-project] 10.222.0.18 "GET /compute/v2.1/servers/ebd2b19d-ddad-422b-a276-0fb7cbe80753" status: 200 len: 1319 microversion: 2.1 time: 0.538020 Jun 24 16:35:23.116429 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 185/346] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:35:22 2022] GET /compute/v2.1/servers/ebd2b19d-ddad-422b-a276-0fb7cbe80753 => generated 1319 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 16:35:23.605399 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-b94094ff-77e8-456b-b090-b244bc7a9bc0 tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Calling method '>' {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:35:23.606114 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-b94094ff-77e8-456b-b090-b244bc7a9bc0 tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] [instance: 2b6c814b-481d-4fba-8cd7-c84aee3f7572] Fetching instance by UUID {{(pid=102149) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:35:23.614475 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-b94094ff-77e8-456b-b090-b244bc7a9bc0 tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:35:23.614959 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-b94094ff-77e8-456b-b090-b244bc7a9bc0 tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:35:23.615986 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-b94094ff-77e8-456b-b090-b244bc7a9bc0 tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:35:23.616439 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-b94094ff-77e8-456b-b090-b244bc7a9bc0 tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:35:23.884460 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-b94094ff-77e8-456b-b090-b244bc7a9bc0 tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65d11cab328748d5a8f5e55eb439e334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901fbc33d59d49f8afa7f06d62e19e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:35:23.895712 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-b94094ff-77e8-456b-b090-b244bc7a9bc0 tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] 10.222.0.18 "GET /compute/v2.1/servers/2b6c814b-481d-4fba-8cd7-c84aee3f7572" status: 200 len: 1265 microversion: 2.1 time: 0.297490 Jun 24 16:35:23.896569 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 162/347] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:35:23 2022] GET /compute/v2.1/servers/2b6c814b-481d-4fba-8cd7-c84aee3f7572 => generated 1265 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 16:35:24.147392 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-ccf5f341-df8c-4f2f-b7a3-c411739b46b9 tempest-VolumesSnapshotTestJSON-1294974655 tempest-VolumesSnapshotTestJSON-1294974655-project] Calling method '>' {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:35:24.149607 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-ccf5f341-df8c-4f2f-b7a3-c411739b46b9 tempest-VolumesSnapshotTestJSON-1294974655 tempest-VolumesSnapshotTestJSON-1294974655-project] [instance: ebd2b19d-ddad-422b-a276-0fb7cbe80753] Fetching instance by UUID {{(pid=102148) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:35:24.165384 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-ccf5f341-df8c-4f2f-b7a3-c411739b46b9 tempest-VolumesSnapshotTestJSON-1294974655 tempest-VolumesSnapshotTestJSON-1294974655-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:35:24.165384 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-ccf5f341-df8c-4f2f-b7a3-c411739b46b9 tempest-VolumesSnapshotTestJSON-1294974655 tempest-VolumesSnapshotTestJSON-1294974655-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:35:24.166217 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-ccf5f341-df8c-4f2f-b7a3-c411739b46b9 tempest-VolumesSnapshotTestJSON-1294974655 tempest-VolumesSnapshotTestJSON-1294974655-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:35:24.167176 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-ccf5f341-df8c-4f2f-b7a3-c411739b46b9 tempest-VolumesSnapshotTestJSON-1294974655 tempest-VolumesSnapshotTestJSON-1294974655-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:35:24.246387 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-aac78a77-3d47-4c08-9836-19eae3484695 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Calling method '>' {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:35:24.247160 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-aac78a77-3d47-4c08-9836-19eae3484695 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] [instance: 24dce890-4ccc-4122-8b62-438ea395fb9a] Fetching instance by UUID {{(pid=102149) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:35:24.267088 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-aac78a77-3d47-4c08-9836-19eae3484695 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:35:24.268796 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-aac78a77-3d47-4c08-9836-19eae3484695 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:35:24.272237 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-aac78a77-3d47-4c08-9836-19eae3484695 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:35:24.272843 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-aac78a77-3d47-4c08-9836-19eae3484695 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:35:24.403221 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-aac78a77-3d47-4c08-9836-19eae3484695 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] 10.222.0.18 "GET /compute/v2.1/servers/24dce890-4ccc-4122-8b62-438ea395fb9a/ips" status: 200 len: 149 microversion: 2.1 time: 0.169389 Jun 24 16:35:24.403870 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 163/348] 10.222.0.18 () {58 vars in 1247 bytes} [Fri Jun 24 16:35:24 2022] GET /compute/v2.1/servers/24dce890-4ccc-4122-8b62-438ea395fb9a/ips => generated 149 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 16:35:24.416749 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-5d714f0a-960e-48a5-b440-6ec7298508ac tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "467872fc-992c-4e59-b37a-ac7871d81099"}} {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 16:35:24.419019 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-5d714f0a-960e-48a5-b440-6ec7298508ac tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] [instance: 24dce890-4ccc-4122-8b62-438ea395fb9a] Fetching instance by UUID {{(pid=102149) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:35:24.428796 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-5d714f0a-960e-48a5-b440-6ec7298508ac tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:35:24.429383 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-5d714f0a-960e-48a5-b440-6ec7298508ac tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:35:24.430560 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-5d714f0a-960e-48a5-b440-6ec7298508ac tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:35:24.431156 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-5d714f0a-960e-48a5-b440-6ec7298508ac tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:35:24.552847 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-ccf5f341-df8c-4f2f-b7a3-c411739b46b9 tempest-VolumesSnapshotTestJSON-1294974655 tempest-VolumesSnapshotTestJSON-1294974655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7b98bac241449c9a8b14307e4f7993a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0966981b5f4c3fa17c73c0c4b31779', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:35:24.565389 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-ccf5f341-df8c-4f2f-b7a3-c411739b46b9 tempest-VolumesSnapshotTestJSON-1294974655 tempest-VolumesSnapshotTestJSON-1294974655-project] 10.222.0.18 "GET /compute/v2.1/servers/ebd2b19d-ddad-422b-a276-0fb7cbe80753" status: 200 len: 1319 microversion: 2.1 time: 0.426272 Jun 24 16:35:24.566338 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 186/349] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:35:24 2022] GET /compute/v2.1/servers/ebd2b19d-ddad-422b-a276-0fb7cbe80753 => generated 1319 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 16:35:24.628137 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.wsgi [None req-5d714f0a-960e-48a5-b440-6ec7298508ac tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] HTTP exception thrown: Invalid volume: volume 467872fc-992c-4e59-b37a-ac7871d81099 is already attached to instances: 2fa4f019-3cbd-4b41-a0fc-6513f46474c0 Jun 24 16:35:24.629408 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-5d714f0a-960e-48a5-b440-6ec7298508ac tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Returning 400 to user: Invalid volume: volume 467872fc-992c-4e59-b37a-ac7871d81099 is already attached to instances: 2fa4f019-3cbd-4b41-a0fc-6513f46474c0 {{(pid=102149) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jun 24 16:35:24.630394 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-5d714f0a-960e-48a5-b440-6ec7298508ac tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] 10.222.0.18 "POST /compute/v2.1/servers/24dce890-4ccc-4122-8b62-438ea395fb9a/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.219609 Jun 24 16:35:24.631312 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 164/350] 10.222.0.18 () {60 vars in 1322 bytes} [Fri Jun 24 16:35:24 2022] POST /compute/v2.1/servers/24dce890-4ccc-4122-8b62-438ea395fb9a/os-volume_attachments => generated 174 bytes in 221 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 24 16:35:24.641669 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-6b37b7c1-fd33-495f-a84b-1c810b13465f tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Calling method '>' {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:35:24.643169 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-6b37b7c1-fd33-495f-a84b-1c810b13465f tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] [instance: 24dce890-4ccc-4122-8b62-438ea395fb9a] Fetching instance by UUID {{(pid=102148) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:35:24.649791 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-6b37b7c1-fd33-495f-a84b-1c810b13465f tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:35:24.650233 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-6b37b7c1-fd33-495f-a84b-1c810b13465f tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:35:24.651067 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-6b37b7c1-fd33-495f-a84b-1c810b13465f tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:35:24.651498 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-6b37b7c1-fd33-495f-a84b-1c810b13465f tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:35:24.719563 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-6b37b7c1-fd33-495f-a84b-1c810b13465f tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] [instance: 24dce890-4ccc-4122-8b62-438ea395fb9a] Going to try to terminate instance {{(pid=102148) delete /opt/stack/nova/nova/compute/api.py:2562}} Jun 24 16:35:24.859488 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-6b37b7c1-fd33-495f-a84b-1c810b13465f tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] 10.222.0.18 "DELETE /compute/v2.1/servers/24dce890-4ccc-4122-8b62-438ea395fb9a" status: 204 len: 0 microversion: 2.1 time: 0.222002 Jun 24 16:35:24.860460 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 187/351] 10.222.0.18 () {58 vars in 1238 bytes} [Fri Jun 24 16:35:24 2022] DELETE /compute/v2.1/servers/24dce890-4ccc-4122-8b62-438ea395fb9a => generated 0 bytes in 224 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 24 16:35:24.872286 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-f271996a-2f45-4872-87a3-4d471e284700 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Calling method '>' {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:35:24.873143 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-f271996a-2f45-4872-87a3-4d471e284700 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] [instance: 24dce890-4ccc-4122-8b62-438ea395fb9a] Fetching instance by UUID {{(pid=102149) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:35:24.881309 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-f271996a-2f45-4872-87a3-4d471e284700 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:35:24.881752 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-f271996a-2f45-4872-87a3-4d471e284700 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:35:24.882522 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-f271996a-2f45-4872-87a3-4d471e284700 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:35:24.882981 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-f271996a-2f45-4872-87a3-4d471e284700 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:35:24.919842 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-01977489-5ef9-4039-a2a8-6403ae7ef4c3 tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Calling method '>' {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:35:24.921088 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-01977489-5ef9-4039-a2a8-6403ae7ef4c3 tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] [instance: 2b6c814b-481d-4fba-8cd7-c84aee3f7572] Fetching instance by UUID {{(pid=102148) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:35:24.933018 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-01977489-5ef9-4039-a2a8-6403ae7ef4c3 tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:35:24.933819 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-01977489-5ef9-4039-a2a8-6403ae7ef4c3 tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:35:24.935017 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-01977489-5ef9-4039-a2a8-6403ae7ef4c3 tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:35:24.935672 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-01977489-5ef9-4039-a2a8-6403ae7ef4c3 tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:35:25.203921 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-f271996a-2f45-4872-87a3-4d471e284700 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '499faf87cf8c41ae823b2566e4c2d8ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606ba814a2d8408ab0856d539ca79b4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:35:25.222236 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-f271996a-2f45-4872-87a3-4d471e284700 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] 10.222.0.18 "GET /compute/v2.1/servers/24dce890-4ccc-4122-8b62-438ea395fb9a" status: 200 len: 1680 microversion: 2.1 time: 0.352998 Jun 24 16:35:25.224299 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 165/352] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:35:24 2022] GET /compute/v2.1/servers/24dce890-4ccc-4122-8b62-438ea395fb9a => generated 1680 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 16:35:25.274288 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-01977489-5ef9-4039-a2a8-6403ae7ef4c3 tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65d11cab328748d5a8f5e55eb439e334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901fbc33d59d49f8afa7f06d62e19e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:35:25.286363 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-01977489-5ef9-4039-a2a8-6403ae7ef4c3 tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] 10.222.0.18 "GET /compute/v2.1/servers/2b6c814b-481d-4fba-8cd7-c84aee3f7572" status: 200 len: 1265 microversion: 2.1 time: 0.374341 Jun 24 16:35:25.287253 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 188/353] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:35:24 2022] GET /compute/v2.1/servers/2b6c814b-481d-4fba-8cd7-c84aee3f7572 => generated 1265 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 16:35:25.447792 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [req-0c2184e8-c668-413f-9979-527aa7d5a2d1 req-12ebba50-ff49-4589-b4f0-1637c78c79e2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2b6c814b-481d-4fba-8cd7-c84aee3f7572", "name": "network-vif-plugged", "status": "completed", "tag": "27aaebe5-51e8-49c2-8f07-e0e78f4459fd"}]} {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 16:35:25.450535 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 24 16:35:25.450535 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: warnings.warn(msg) Jun 24 16:35:25.465002 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [req-0c2184e8-c668-413f-9979-527aa7d5a2d1 req-12ebba50-ff49-4589-b4f0-1637c78c79e2 service nova] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:35:25.465761 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [req-0c2184e8-c668-413f-9979-527aa7d5a2d1 req-12ebba50-ff49-4589-b4f0-1637c78c79e2 service nova] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:35:25.492662 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.compute.server_external_events [req-0c2184e8-c668-413f-9979-527aa7d5a2d1 req-12ebba50-ff49-4589-b4f0-1637c78c79e2 service nova] Creating event network-vif-plugged:27aaebe5-51e8-49c2-8f07-e0e78f4459fd for instance 2b6c814b-481d-4fba-8cd7-c84aee3f7572 on hv-cinder-84718 Jun 24 16:35:25.500353 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [req-0c2184e8-c668-413f-9979-527aa7d5a2d1 req-12ebba50-ff49-4589-b4f0-1637c78c79e2 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059870 Jun 24 16:35:25.501416 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 166/354] 10.222.0.18 () {64 vars in 1317 bytes} [Fri Jun 24 16:35:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 16:35:25.592996 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-54e89325-a865-41f0-a650-41fcc55eddb7 tempest-VolumesSnapshotTestJSON-1294974655 tempest-VolumesSnapshotTestJSON-1294974655-project] Calling method '>' {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:35:25.594042 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-54e89325-a865-41f0-a650-41fcc55eddb7 tempest-VolumesSnapshotTestJSON-1294974655 tempest-VolumesSnapshotTestJSON-1294974655-project] [instance: ebd2b19d-ddad-422b-a276-0fb7cbe80753] Fetching instance by UUID {{(pid=102148) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:35:25.606261 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-54e89325-a865-41f0-a650-41fcc55eddb7 tempest-VolumesSnapshotTestJSON-1294974655 tempest-VolumesSnapshotTestJSON-1294974655-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:35:25.606895 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-54e89325-a865-41f0-a650-41fcc55eddb7 tempest-VolumesSnapshotTestJSON-1294974655 tempest-VolumesSnapshotTestJSON-1294974655-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:35:25.607671 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-54e89325-a865-41f0-a650-41fcc55eddb7 tempest-VolumesSnapshotTestJSON-1294974655 tempest-VolumesSnapshotTestJSON-1294974655-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:35:25.608124 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-54e89325-a865-41f0-a650-41fcc55eddb7 tempest-VolumesSnapshotTestJSON-1294974655 tempest-VolumesSnapshotTestJSON-1294974655-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:35:25.961048 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-54e89325-a865-41f0-a650-41fcc55eddb7 tempest-VolumesSnapshotTestJSON-1294974655 tempest-VolumesSnapshotTestJSON-1294974655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7b98bac241449c9a8b14307e4f7993a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0966981b5f4c3fa17c73c0c4b31779', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:35:25.972073 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-54e89325-a865-41f0-a650-41fcc55eddb7 tempest-VolumesSnapshotTestJSON-1294974655 tempest-VolumesSnapshotTestJSON-1294974655-project] 10.222.0.18 "GET /compute/v2.1/servers/ebd2b19d-ddad-422b-a276-0fb7cbe80753" status: 200 len: 1508 microversion: 2.1 time: 0.382845 Jun 24 16:35:25.972665 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 189/355] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:35:25 2022] GET /compute/v2.1/servers/ebd2b19d-ddad-422b-a276-0fb7cbe80753 => generated 1508 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 16:35:26.242002 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-aa140179-ad45-4e12-ada1-464ef3ebf23c tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Calling method '>' {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:35:26.242617 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-aa140179-ad45-4e12-ada1-464ef3ebf23c tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] [instance: 24dce890-4ccc-4122-8b62-438ea395fb9a] Fetching instance by UUID {{(pid=102149) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:35:26.252337 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-aa140179-ad45-4e12-ada1-464ef3ebf23c tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:35:26.252792 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-aa140179-ad45-4e12-ada1-464ef3ebf23c tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:35:26.253741 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-aa140179-ad45-4e12-ada1-464ef3ebf23c tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:35:26.254183 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-aa140179-ad45-4e12-ada1-464ef3ebf23c tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:35:26.311458 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-96d5230e-acce-4692-9d7c-4af00aa08ace tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Calling method '>' {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:35:26.313783 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-96d5230e-acce-4692-9d7c-4af00aa08ace tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] [instance: 2b6c814b-481d-4fba-8cd7-c84aee3f7572] Fetching instance by UUID {{(pid=102148) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:35:26.324884 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-96d5230e-acce-4692-9d7c-4af00aa08ace tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:35:26.326049 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-96d5230e-acce-4692-9d7c-4af00aa08ace tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:35:26.327805 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-96d5230e-acce-4692-9d7c-4af00aa08ace tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:35:26.328896 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-96d5230e-acce-4692-9d7c-4af00aa08ace tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:35:26.592055 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-aa140179-ad45-4e12-ada1-464ef3ebf23c tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '499faf87cf8c41ae823b2566e4c2d8ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606ba814a2d8408ab0856d539ca79b4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:35:26.601670 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-aa140179-ad45-4e12-ada1-464ef3ebf23c tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] 10.222.0.18 "GET /compute/v2.1/servers/24dce890-4ccc-4122-8b62-438ea395fb9a" status: 200 len: 1680 microversion: 2.1 time: 0.363909 Jun 24 16:35:26.602475 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 167/356] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:35:26 2022] GET /compute/v2.1/servers/24dce890-4ccc-4122-8b62-438ea395fb9a => generated 1680 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 16:35:26.684540 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-96d5230e-acce-4692-9d7c-4af00aa08ace tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65d11cab328748d5a8f5e55eb439e334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901fbc33d59d49f8afa7f06d62e19e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:35:26.696678 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-96d5230e-acce-4692-9d7c-4af00aa08ace tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] 10.222.0.18 "GET /compute/v2.1/servers/2b6c814b-481d-4fba-8cd7-c84aee3f7572" status: 200 len: 1265 microversion: 2.1 time: 0.390940 Jun 24 16:35:26.698216 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 190/357] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:35:26 2022] GET /compute/v2.1/servers/2b6c814b-481d-4fba-8cd7-c84aee3f7572 => generated 1265 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 16:35:27.626123 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-314e5e8b-5eda-4a4a-803a-ce12b0524cac tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Calling method '>' {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:35:27.627018 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-314e5e8b-5eda-4a4a-803a-ce12b0524cac tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] [instance: 24dce890-4ccc-4122-8b62-438ea395fb9a] Fetching instance by UUID {{(pid=102149) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:35:27.635420 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-314e5e8b-5eda-4a4a-803a-ce12b0524cac tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:35:27.635872 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-314e5e8b-5eda-4a4a-803a-ce12b0524cac tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:35:27.636680 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-314e5e8b-5eda-4a4a-803a-ce12b0524cac tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:35:27.637137 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-314e5e8b-5eda-4a4a-803a-ce12b0524cac tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:35:27.723719 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-30a2ca15-26b5-4f6d-98af-9085f3ee2e69 tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Calling method '>' {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:35:27.725089 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-30a2ca15-26b5-4f6d-98af-9085f3ee2e69 tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] [instance: 2b6c814b-481d-4fba-8cd7-c84aee3f7572] Fetching instance by UUID {{(pid=102148) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:35:27.737342 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-30a2ca15-26b5-4f6d-98af-9085f3ee2e69 tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:35:27.737796 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-30a2ca15-26b5-4f6d-98af-9085f3ee2e69 tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:35:27.738602 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-30a2ca15-26b5-4f6d-98af-9085f3ee2e69 tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:35:27.739070 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-30a2ca15-26b5-4f6d-98af-9085f3ee2e69 tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:35:28.157267 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-30a2ca15-26b5-4f6d-98af-9085f3ee2e69 tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65d11cab328748d5a8f5e55eb439e334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901fbc33d59d49f8afa7f06d62e19e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:35:28.161356 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-314e5e8b-5eda-4a4a-803a-ce12b0524cac tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '499faf87cf8c41ae823b2566e4c2d8ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606ba814a2d8408ab0856d539ca79b4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:35:28.166397 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-30a2ca15-26b5-4f6d-98af-9085f3ee2e69 tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] 10.222.0.18 "GET /compute/v2.1/servers/2b6c814b-481d-4fba-8cd7-c84aee3f7572" status: 200 len: 1265 microversion: 2.1 time: 0.449665 Jun 24 16:35:28.167024 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 191/358] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:35:27 2022] GET /compute/v2.1/servers/2b6c814b-481d-4fba-8cd7-c84aee3f7572 => generated 1265 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 16:35:28.173451 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-314e5e8b-5eda-4a4a-803a-ce12b0524cac tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] 10.222.0.18 "GET /compute/v2.1/servers/24dce890-4ccc-4122-8b62-438ea395fb9a" status: 200 len: 1680 microversion: 2.1 time: 0.553877 Jun 24 16:35:28.174590 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 168/359] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:35:27 2022] GET /compute/v2.1/servers/24dce890-4ccc-4122-8b62-438ea395fb9a => generated 1680 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 16:35:29.189202 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-7f48b6ec-d288-46d7-98de-105c1b359b16 tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Calling method '>' {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:35:29.190806 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-7f48b6ec-d288-46d7-98de-105c1b359b16 tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] [instance: 2b6c814b-481d-4fba-8cd7-c84aee3f7572] Fetching instance by UUID {{(pid=102148) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:35:29.195230 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-eddcbc36-e08e-46d4-952f-1746feb3ee51 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Calling method '>' {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:35:29.196154 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-eddcbc36-e08e-46d4-952f-1746feb3ee51 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] [instance: 24dce890-4ccc-4122-8b62-438ea395fb9a] Fetching instance by UUID {{(pid=102149) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:35:29.204274 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-7f48b6ec-d288-46d7-98de-105c1b359b16 tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:35:29.205032 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-7f48b6ec-d288-46d7-98de-105c1b359b16 tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:35:29.205879 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-eddcbc36-e08e-46d4-952f-1746feb3ee51 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:35:29.206357 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-eddcbc36-e08e-46d4-952f-1746feb3ee51 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:35:29.206650 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-7f48b6ec-d288-46d7-98de-105c1b359b16 tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:35:29.207273 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-eddcbc36-e08e-46d4-952f-1746feb3ee51 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:35:29.207693 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-7f48b6ec-d288-46d7-98de-105c1b359b16 tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:35:29.207827 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-eddcbc36-e08e-46d4-952f-1746feb3ee51 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:35:29.579673 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-7f48b6ec-d288-46d7-98de-105c1b359b16 tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65d11cab328748d5a8f5e55eb439e334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901fbc33d59d49f8afa7f06d62e19e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:35:29.595384 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-7f48b6ec-d288-46d7-98de-105c1b359b16 tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] 10.222.0.18 "GET /compute/v2.1/servers/2b6c814b-481d-4fba-8cd7-c84aee3f7572" status: 200 len: 1265 microversion: 2.1 time: 0.409740 Jun 24 16:35:29.596704 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 192/360] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:35:29 2022] GET /compute/v2.1/servers/2b6c814b-481d-4fba-8cd7-c84aee3f7572 => generated 1265 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 16:35:29.604934 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-eddcbc36-e08e-46d4-952f-1746feb3ee51 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '499faf87cf8c41ae823b2566e4c2d8ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606ba814a2d8408ab0856d539ca79b4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:35:29.615760 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-eddcbc36-e08e-46d4-952f-1746feb3ee51 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] 10.222.0.18 "GET /compute/v2.1/servers/24dce890-4ccc-4122-8b62-438ea395fb9a" status: 200 len: 1680 microversion: 2.1 time: 0.426059 Jun 24 16:35:29.616313 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 169/361] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:35:29 2022] GET /compute/v2.1/servers/24dce890-4ccc-4122-8b62-438ea395fb9a => generated 1680 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 16:35:30.618408 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-0e9fdc12-c7c7-4a2c-93a1-a7fdc08334c6 tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Calling method '>' {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:35:30.619334 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-0e9fdc12-c7c7-4a2c-93a1-a7fdc08334c6 tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] [instance: 2b6c814b-481d-4fba-8cd7-c84aee3f7572] Fetching instance by UUID {{(pid=102148) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:35:30.632776 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-0e9fdc12-c7c7-4a2c-93a1-a7fdc08334c6 tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:35:30.633436 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-107f5c45-0a53-4793-b744-eea1dde7f05e tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Calling method '>' {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:35:30.634002 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-0e9fdc12-c7c7-4a2c-93a1-a7fdc08334c6 tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:35:30.635337 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-107f5c45-0a53-4793-b744-eea1dde7f05e tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] [instance: 24dce890-4ccc-4122-8b62-438ea395fb9a] Fetching instance by UUID {{(pid=102149) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:35:30.637915 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-0e9fdc12-c7c7-4a2c-93a1-a7fdc08334c6 tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:35:30.639992 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-0e9fdc12-c7c7-4a2c-93a1-a7fdc08334c6 tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:35:30.652493 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-107f5c45-0a53-4793-b744-eea1dde7f05e tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:35:30.653740 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-107f5c45-0a53-4793-b744-eea1dde7f05e tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:35:30.655212 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-107f5c45-0a53-4793-b744-eea1dde7f05e tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:35:30.655789 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-107f5c45-0a53-4793-b744-eea1dde7f05e tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:35:31.337383 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-0e9fdc12-c7c7-4a2c-93a1-a7fdc08334c6 tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65d11cab328748d5a8f5e55eb439e334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901fbc33d59d49f8afa7f06d62e19e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:35:31.352778 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-0e9fdc12-c7c7-4a2c-93a1-a7fdc08334c6 tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] 10.222.0.18 "GET /compute/v2.1/servers/2b6c814b-481d-4fba-8cd7-c84aee3f7572" status: 200 len: 1451 microversion: 2.1 time: 0.740526 Jun 24 16:35:31.353904 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 193/362] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:35:30 2022] GET /compute/v2.1/servers/2b6c814b-481d-4fba-8cd7-c84aee3f7572 => generated 1451 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 16:35:31.360099 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-4b94aa2a-44ba-47bc-bab7-93b3d027ae28 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 16:35:31.361463 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-4b94aa2a-44ba-47bc-bab7-93b3d027ae28 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] [instance: 1739cd84-3709-4cf4-95e3-82de4b4d3d7a] Fetching instance by UUID {{(pid=102148) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:35:31.379758 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-4b94aa2a-44ba-47bc-bab7-93b3d027ae28 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:35:31.380306 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-4b94aa2a-44ba-47bc-bab7-93b3d027ae28 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:35:31.381209 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-4b94aa2a-44ba-47bc-bab7-93b3d027ae28 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:35:31.381725 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-4b94aa2a-44ba-47bc-bab7-93b3d027ae28 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:35:31.412391 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-107f5c45-0a53-4793-b744-eea1dde7f05e tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '499faf87cf8c41ae823b2566e4c2d8ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606ba814a2d8408ab0856d539ca79b4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:35:31.433480 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-107f5c45-0a53-4793-b744-eea1dde7f05e tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] 10.222.0.18 "GET /compute/v2.1/servers/24dce890-4ccc-4122-8b62-438ea395fb9a" status: 200 len: 1680 microversion: 2.1 time: 0.803687 Jun 24 16:35:31.435273 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 170/363] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:35:30 2022] GET /compute/v2.1/servers/24dce890-4ccc-4122-8b62-438ea395fb9a => generated 1680 bytes in 807 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 16:35:31.444545 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-ffe35f8a-77ed-4e7b-bf89-6f0a118c2561 tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Calling method '>' {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:35:31.445621 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-ffe35f8a-77ed-4e7b-bf89-6f0a118c2561 tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] [instance: 2b6c814b-481d-4fba-8cd7-c84aee3f7572] Fetching instance by UUID {{(pid=102149) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:35:31.458387 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-ffe35f8a-77ed-4e7b-bf89-6f0a118c2561 tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:35:31.459640 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-ffe35f8a-77ed-4e7b-bf89-6f0a118c2561 tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:35:31.461259 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-ffe35f8a-77ed-4e7b-bf89-6f0a118c2561 tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:35:31.462094 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-ffe35f8a-77ed-4e7b-bf89-6f0a118c2561 tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:35:31.489897 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.objects.instance [None req-4b94aa2a-44ba-47bc-bab7-93b3d027ae28 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lazy-loading 'flavor' on Instance uuid 1739cd84-3709-4cf4-95e3-82de4b4d3d7a {{(pid=102148) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Jun 24 16:35:31.833036 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-4b94aa2a-44ba-47bc-bab7-93b3d027ae28 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] 10.222.0.18 "POST /compute/v2.1/servers/1739cd84-3709-4cf4-95e3-82de4b4d3d7a/action" status: 200 len: 32 microversion: 2.1 time: 0.477425 Jun 24 16:35:31.834162 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 194/364] 10.222.0.18 () {60 vars in 1277 bytes} [Fri Jun 24 16:35:31 2022] POST /compute/v2.1/servers/1739cd84-3709-4cf4-95e3-82de4b4d3d7a/action => generated 32 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 24 16:35:31.848758 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-646bbd54-dcf9-4d26-a942-ef8f66930843 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Calling method '>' {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:35:31.849473 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-646bbd54-dcf9-4d26-a942-ef8f66930843 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] [instance: 1739cd84-3709-4cf4-95e3-82de4b4d3d7a] Fetching instance by UUID {{(pid=102148) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:35:31.875812 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-646bbd54-dcf9-4d26-a942-ef8f66930843 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:35:31.876347 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-646bbd54-dcf9-4d26-a942-ef8f66930843 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:35:31.877238 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-646bbd54-dcf9-4d26-a942-ef8f66930843 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:35:31.877852 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-646bbd54-dcf9-4d26-a942-ef8f66930843 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:35:32.124814 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-ffe35f8a-77ed-4e7b-bf89-6f0a118c2561 tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65d11cab328748d5a8f5e55eb439e334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901fbc33d59d49f8afa7f06d62e19e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:35:32.140830 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-ffe35f8a-77ed-4e7b-bf89-6f0a118c2561 tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] 10.222.0.18 "GET /compute/v2.1/servers/2b6c814b-481d-4fba-8cd7-c84aee3f7572" status: 200 len: 1451 microversion: 2.1 time: 0.703333 Jun 24 16:35:32.142016 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 171/365] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:35:31 2022] GET /compute/v2.1/servers/2b6c814b-481d-4fba-8cd7-c84aee3f7572 => generated 1451 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 16:35:32.456816 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-921414d3-5d95-436f-be19-ad22d04c4c3d tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Calling method '>' {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:35:32.458869 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-921414d3-5d95-436f-be19-ad22d04c4c3d tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] [instance: 24dce890-4ccc-4122-8b62-438ea395fb9a] Fetching instance by UUID {{(pid=102149) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:35:32.478636 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-921414d3-5d95-436f-be19-ad22d04c4c3d tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:35:32.479459 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-921414d3-5d95-436f-be19-ad22d04c4c3d tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:35:32.480460 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-921414d3-5d95-436f-be19-ad22d04c4c3d tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:35:32.481237 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-921414d3-5d95-436f-be19-ad22d04c4c3d tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:35:32.713852 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-921414d3-5d95-436f-be19-ad22d04c4c3d tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '499faf87cf8c41ae823b2566e4c2d8ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606ba814a2d8408ab0856d539ca79b4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:35:32.734029 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-921414d3-5d95-436f-be19-ad22d04c4c3d tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] 10.222.0.18 "GET /compute/v2.1/servers/24dce890-4ccc-4122-8b62-438ea395fb9a" status: 200 len: 1613 microversion: 2.1 time: 0.282284 Jun 24 16:35:32.752620 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 172/366] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:35:32 2022] GET /compute/v2.1/servers/24dce890-4ccc-4122-8b62-438ea395fb9a => generated 1613 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 16:35:32.785575 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [req-dd93bf0a-adc5-4648-b3bc-cc48c11b6d6d req-b9f216e9-63ff-468b-9bf7-580f32142ec8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "24dce890-4ccc-4122-8b62-438ea395fb9a", "name": "network-vif-deleted", "tag": "da1e5556-b87a-41c9-8727-30b8a9ea8c11"}]} {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 16:35:32.797092 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 24 16:35:32.797092 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: warnings.warn(msg) Jun 24 16:35:32.798931 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-646bbd54-dcf9-4d26-a942-ef8f66930843 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c286a3f03048689e5ec552bb89c161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09584de3a4b14c5a90eb9b1c2149d6fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:35:32.816170 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-646bbd54-dcf9-4d26-a942-ef8f66930843 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] 10.222.0.18 "GET /compute/v2.1/servers/1739cd84-3709-4cf4-95e3-82de4b4d3d7a" status: 200 len: 1735 microversion: 2.1 time: 0.970324 Jun 24 16:35:32.820131 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 195/367] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:35:31 2022] GET /compute/v2.1/servers/1739cd84-3709-4cf4-95e3-82de4b4d3d7a => generated 1735 bytes in 976 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 16:35:32.828689 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [req-dd93bf0a-adc5-4648-b3bc-cc48c11b6d6d req-b9f216e9-63ff-468b-9bf7-580f32142ec8 service nova] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:35:32.829742 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [req-dd93bf0a-adc5-4648-b3bc-cc48c11b6d6d req-b9f216e9-63ff-468b-9bf7-580f32142ec8 service nova] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:35:32.862203 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.compute.server_external_events [req-dd93bf0a-adc5-4648-b3bc-cc48c11b6d6d req-b9f216e9-63ff-468b-9bf7-580f32142ec8 service nova] Creating event network-vif-deleted:da1e5556-b87a-41c9-8727-30b8a9ea8c11 for instance 24dce890-4ccc-4122-8b62-438ea395fb9a on hv-cinder-84718 Jun 24 16:35:32.867758 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [req-dd93bf0a-adc5-4648-b3bc-cc48c11b6d6d req-b9f216e9-63ff-468b-9bf7-580f32142ec8 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092083 Jun 24 16:35:32.868697 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 173/368] 10.222.0.18 () {64 vars in 1317 bytes} [Fri Jun 24 16:35:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 16:35:33.762086 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-649bb1a8-ce9e-4c4c-884e-4c018b0567f6 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Calling method '>' {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:35:33.769332 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-649bb1a8-ce9e-4c4c-884e-4c018b0567f6 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] [instance: 24dce890-4ccc-4122-8b62-438ea395fb9a] Fetching instance by UUID {{(pid=102148) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:35:33.782892 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-649bb1a8-ce9e-4c4c-884e-4c018b0567f6 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:35:33.783750 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-649bb1a8-ce9e-4c4c-884e-4c018b0567f6 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:35:33.784860 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-649bb1a8-ce9e-4c4c-884e-4c018b0567f6 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:35:33.785674 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-649bb1a8-ce9e-4c4c-884e-4c018b0567f6 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:35:33.843234 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-e165e18c-f1a2-48c9-be7a-017b1bae72cf tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Calling method '>' {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:35:33.845250 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-e165e18c-f1a2-48c9-be7a-017b1bae72cf tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] [instance: 1739cd84-3709-4cf4-95e3-82de4b4d3d7a] Fetching instance by UUID {{(pid=102149) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:35:33.878733 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-e165e18c-f1a2-48c9-be7a-017b1bae72cf tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:35:33.883049 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-e165e18c-f1a2-48c9-be7a-017b1bae72cf tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:35:33.887005 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-e165e18c-f1a2-48c9-be7a-017b1bae72cf tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:35:33.887005 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-e165e18c-f1a2-48c9-be7a-017b1bae72cf tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:35:34.075841 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-649bb1a8-ce9e-4c4c-884e-4c018b0567f6 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '499faf87cf8c41ae823b2566e4c2d8ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606ba814a2d8408ab0856d539ca79b4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:35:34.104054 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-649bb1a8-ce9e-4c4c-884e-4c018b0567f6 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] 10.222.0.18 "GET /compute/v2.1/servers/24dce890-4ccc-4122-8b62-438ea395fb9a" status: 200 len: 1613 microversion: 2.1 time: 0.346824 Jun 24 16:35:34.115765 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 196/369] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:35:33 2022] GET /compute/v2.1/servers/24dce890-4ccc-4122-8b62-438ea395fb9a => generated 1613 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 16:35:34.423140 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-e165e18c-f1a2-48c9-be7a-017b1bae72cf tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c286a3f03048689e5ec552bb89c161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09584de3a4b14c5a90eb9b1c2149d6fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:35:34.447531 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-e165e18c-f1a2-48c9-be7a-017b1bae72cf tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] 10.222.0.18 "GET /compute/v2.1/servers/1739cd84-3709-4cf4-95e3-82de4b4d3d7a" status: 200 len: 1735 microversion: 2.1 time: 0.616146 Jun 24 16:35:34.466030 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 174/370] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:35:33 2022] GET /compute/v2.1/servers/1739cd84-3709-4cf4-95e3-82de4b4d3d7a => generated 1735 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 16:35:35.130145 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-d95e01fa-bc4c-42c9-8fa2-cb376ca0d543 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Calling method '>' {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:35:35.131708 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-d95e01fa-bc4c-42c9-8fa2-cb376ca0d543 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] [instance: 24dce890-4ccc-4122-8b62-438ea395fb9a] Fetching instance by UUID {{(pid=102148) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:35:35.151326 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-d95e01fa-bc4c-42c9-8fa2-cb376ca0d543 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:35:35.156995 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-d95e01fa-bc4c-42c9-8fa2-cb376ca0d543 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:35:35.158394 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-d95e01fa-bc4c-42c9-8fa2-cb376ca0d543 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:35:35.163146 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-d95e01fa-bc4c-42c9-8fa2-cb376ca0d543 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:35:35.326750 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-d95e01fa-bc4c-42c9-8fa2-cb376ca0d543 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:35:35.329055 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-d95e01fa-bc4c-42c9-8fa2-cb376ca0d543 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:35:35.330462 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.objects.instance [None req-d95e01fa-bc4c-42c9-8fa2-cb376ca0d543 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lazy-loading 'fault' on Instance uuid 24dce890-4ccc-4122-8b62-438ea395fb9a {{(pid=102148) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Jun 24 16:35:35.466788 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-e00f32b2-7e9c-4a93-8826-8cd839b76558 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Calling method '>' {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:35:35.467607 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-e00f32b2-7e9c-4a93-8826-8cd839b76558 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] [instance: 1739cd84-3709-4cf4-95e3-82de4b4d3d7a] Fetching instance by UUID {{(pid=102149) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:35:35.490401 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-e00f32b2-7e9c-4a93-8826-8cd839b76558 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:35:35.490995 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-e00f32b2-7e9c-4a93-8826-8cd839b76558 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:35:35.491811 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-e00f32b2-7e9c-4a93-8826-8cd839b76558 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:35:35.492255 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-e00f32b2-7e9c-4a93-8826-8cd839b76558 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:35:35.510807 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-d95e01fa-bc4c-42c9-8fa2-cb376ca0d543 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '499faf87cf8c41ae823b2566e4c2d8ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606ba814a2d8408ab0856d539ca79b4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:35:35.533228 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-d95e01fa-bc4c-42c9-8fa2-cb376ca0d543 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] 10.222.0.18 "GET /compute/v2.1/servers/24dce890-4ccc-4122-8b62-438ea395fb9a" status: 200 len: 1331 microversion: 2.1 time: 0.406814 Jun 24 16:35:35.534585 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 197/371] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:35:35 2022] GET /compute/v2.1/servers/24dce890-4ccc-4122-8b62-438ea395fb9a => generated 1331 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 16:35:36.045869 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-e00f32b2-7e9c-4a93-8826-8cd839b76558 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c286a3f03048689e5ec552bb89c161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09584de3a4b14c5a90eb9b1c2149d6fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:35:36.055586 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-e00f32b2-7e9c-4a93-8826-8cd839b76558 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] 10.222.0.18 "GET /compute/v2.1/servers/1739cd84-3709-4cf4-95e3-82de4b4d3d7a" status: 200 len: 1735 microversion: 2.1 time: 0.593621 Jun 24 16:35:36.062828 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 175/372] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:35:35 2022] GET /compute/v2.1/servers/1739cd84-3709-4cf4-95e3-82de4b4d3d7a => generated 1735 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 16:35:36.560767 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-8800b657-dd88-4a72-b776-e3610a8efa43 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Calling method '>' {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:35:36.561383 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-8800b657-dd88-4a72-b776-e3610a8efa43 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] [instance: 24dce890-4ccc-4122-8b62-438ea395fb9a] Fetching instance by UUID {{(pid=102148) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:35:36.577044 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-8800b657-dd88-4a72-b776-e3610a8efa43 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:35:36.577044 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-8800b657-dd88-4a72-b776-e3610a8efa43 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:35:36.577822 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-8800b657-dd88-4a72-b776-e3610a8efa43 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:35:36.578431 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-8800b657-dd88-4a72-b776-e3610a8efa43 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:35:36.586366 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [req-4401fabe-700c-4389-9bdd-f3cb1d6d7dc2 req-2f1e2afc-bafd-426d-ade1-af12832dd109 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2b6c814b-481d-4fba-8cd7-c84aee3f7572", "tag": "27aaebe5-51e8-49c2-8f07-e0e78f4459fd"}]} {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 16:35:36.589352 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 24 16:35:36.589352 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: warnings.warn(msg) Jun 24 16:35:36.598771 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [req-4401fabe-700c-4389-9bdd-f3cb1d6d7dc2 req-2f1e2afc-bafd-426d-ade1-af12832dd109 service nova] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:35:36.599510 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [req-4401fabe-700c-4389-9bdd-f3cb1d6d7dc2 req-2f1e2afc-bafd-426d-ade1-af12832dd109 service nova] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:35:36.625838 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.compute.server_external_events [req-4401fabe-700c-4389-9bdd-f3cb1d6d7dc2 req-2f1e2afc-bafd-426d-ade1-af12832dd109 service nova] Creating event network-changed:27aaebe5-51e8-49c2-8f07-e0e78f4459fd for instance 2b6c814b-481d-4fba-8cd7-c84aee3f7572 on hv-cinder-84718 Jun 24 16:35:36.633701 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [req-4401fabe-700c-4389-9bdd-f3cb1d6d7dc2 req-2f1e2afc-bafd-426d-ade1-af12832dd109 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051074 Jun 24 16:35:36.635232 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 176/373] 10.222.0.18 () {64 vars in 1317 bytes} [Fri Jun 24 16:35:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 16:35:36.643552 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.wsgi [None req-8800b657-dd88-4a72-b776-e3610a8efa43 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] HTTP exception thrown: Instance 24dce890-4ccc-4122-8b62-438ea395fb9a could not be found. Jun 24 16:35:36.644493 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-8800b657-dd88-4a72-b776-e3610a8efa43 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Returning 404 to user: Instance 24dce890-4ccc-4122-8b62-438ea395fb9a could not be found. {{(pid=102148) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jun 24 16:35:36.645345 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-8800b657-dd88-4a72-b776-e3610a8efa43 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] 10.222.0.18 "GET /compute/v2.1/servers/24dce890-4ccc-4122-8b62-438ea395fb9a" status: 404 len: 111 microversion: 2.1 time: 0.096273 Jun 24 16:35:36.645907 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 198/374] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:35:36 2022] GET /compute/v2.1/servers/24dce890-4ccc-4122-8b62-438ea395fb9a => generated 111 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 16:35:36.659262 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-ee43e483-be9b-42e3-a237-257fb15177c4 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Calling method '.version_select at 0x7f1ae2ff7430>' {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:35:36.694555 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-ee43e483-be9b-42e3-a237-257fb15177c4 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-494932195" status: 202 len: 0 microversion: 2.1 time: 0.042526 Jun 24 16:35:36.698009 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 177/375] 10.222.0.18 () {58 vars in 1217 bytes} [Fri Jun 24 16:35:36 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-494932195 => generated 0 bytes in 45 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 24 16:35:37.080782 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-8fde7959-6743-4d6a-baa2-3a4e8431023d tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Calling method '>' {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:35:37.085131 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-8fde7959-6743-4d6a-baa2-3a4e8431023d tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] [instance: 1739cd84-3709-4cf4-95e3-82de4b4d3d7a] Fetching instance by UUID {{(pid=102148) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:35:37.098887 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-8fde7959-6743-4d6a-baa2-3a4e8431023d tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:35:37.099622 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-8fde7959-6743-4d6a-baa2-3a4e8431023d tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:35:37.100967 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-8fde7959-6743-4d6a-baa2-3a4e8431023d tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:35:37.101863 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-8fde7959-6743-4d6a-baa2-3a4e8431023d tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:35:37.461783 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-8fde7959-6743-4d6a-baa2-3a4e8431023d tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c286a3f03048689e5ec552bb89c161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09584de3a4b14c5a90eb9b1c2149d6fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:35:37.471436 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-8fde7959-6743-4d6a-baa2-3a4e8431023d tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] 10.222.0.18 "GET /compute/v2.1/servers/1739cd84-3709-4cf4-95e3-82de4b4d3d7a" status: 200 len: 1735 microversion: 2.1 time: 0.397102 Jun 24 16:35:37.472014 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 199/376] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:35:37 2022] GET /compute/v2.1/servers/1739cd84-3709-4cf4-95e3-82de4b4d3d7a => generated 1735 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 16:35:38.331879 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-2570d30d-c493-480f-8956-ee81b7788ebf tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Calling method '>' {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:35:38.332496 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-2570d30d-c493-480f-8956-ee81b7788ebf tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] [instance: 2fa4f019-3cbd-4b41-a0fc-6513f46474c0] Fetching instance by UUID {{(pid=102149) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:35:38.341565 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-2570d30d-c493-480f-8956-ee81b7788ebf tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:35:38.343396 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-2570d30d-c493-480f-8956-ee81b7788ebf tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:35:38.343396 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-2570d30d-c493-480f-8956-ee81b7788ebf tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:35:38.343396 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-2570d30d-c493-480f-8956-ee81b7788ebf tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:35:38.491985 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-f362b5e8-29f0-487c-b8f8-90102fcc002a tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Calling method '>' {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:35:38.492744 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-f362b5e8-29f0-487c-b8f8-90102fcc002a tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] [instance: 1739cd84-3709-4cf4-95e3-82de4b4d3d7a] Fetching instance by UUID {{(pid=102148) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:35:38.505290 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-f362b5e8-29f0-487c-b8f8-90102fcc002a tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:35:38.505904 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-f362b5e8-29f0-487c-b8f8-90102fcc002a tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:35:38.506812 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-f362b5e8-29f0-487c-b8f8-90102fcc002a tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:35:38.507329 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-f362b5e8-29f0-487c-b8f8-90102fcc002a tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:35:38.540168 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.objects.instance [None req-2570d30d-c493-480f-8956-ee81b7788ebf tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lazy-loading 'services' on Instance uuid 2fa4f019-3cbd-4b41-a0fc-6513f46474c0 {{(pid=102149) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Jun 24 16:35:38.724222 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-2570d30d-c493-480f-8956-ee81b7788ebf tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] 10.222.0.18 "DELETE /compute/v2.1/servers/2fa4f019-3cbd-4b41-a0fc-6513f46474c0/os-volume_attachments/467872fc-992c-4e59-b37a-ac7871d81099" status: 202 len: 0 microversion: 2.1 time: 0.396327 Jun 24 16:35:38.724943 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 178/377] 10.222.0.18 () {58 vars in 1415 bytes} [Fri Jun 24 16:35:38 2022] DELETE /compute/v2.1/servers/2fa4f019-3cbd-4b41-a0fc-6513f46474c0/os-volume_attachments/467872fc-992c-4e59-b37a-ac7871d81099 => generated 0 bytes in 398 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 24 16:35:38.734459 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-5a5cbd73-da07-43be-b620-cb6d3eee4204 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Calling method '>' {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:35:38.735864 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-5a5cbd73-da07-43be-b620-cb6d3eee4204 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] [instance: 2fa4f019-3cbd-4b41-a0fc-6513f46474c0] Fetching instance by UUID {{(pid=102149) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:35:38.743403 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-5a5cbd73-da07-43be-b620-cb6d3eee4204 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:35:38.744453 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-5a5cbd73-da07-43be-b620-cb6d3eee4204 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:35:38.745231 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-5a5cbd73-da07-43be-b620-cb6d3eee4204 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:35:38.745668 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-5a5cbd73-da07-43be-b620-cb6d3eee4204 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:35:38.749592 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-f362b5e8-29f0-487c-b8f8-90102fcc002a tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c286a3f03048689e5ec552bb89c161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09584de3a4b14c5a90eb9b1c2149d6fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:35:38.759223 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-f362b5e8-29f0-487c-b8f8-90102fcc002a tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] 10.222.0.18 "GET /compute/v2.1/servers/1739cd84-3709-4cf4-95e3-82de4b4d3d7a" status: 200 len: 1735 microversion: 2.1 time: 0.273203 Jun 24 16:35:38.759932 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 200/378] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:35:38 2022] GET /compute/v2.1/servers/1739cd84-3709-4cf4-95e3-82de4b4d3d7a => generated 1735 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 16:35:38.815987 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-5a5cbd73-da07-43be-b620-cb6d3eee4204 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] 10.222.0.18 "GET /compute/v2.1/servers/2fa4f019-3cbd-4b41-a0fc-6513f46474c0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.085711 Jun 24 16:35:38.816848 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 179/379] 10.222.0.18 () {58 vars in 1301 bytes} [Fri Jun 24 16:35:38 2022] GET /compute/v2.1/servers/2fa4f019-3cbd-4b41-a0fc-6513f46474c0/os-volume_attachments => generated 197 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 16:35:39.780797 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-a043e738-c77e-49cd-94f2-cb64f385e3a3 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Calling method '>' {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:35:39.781911 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-a043e738-c77e-49cd-94f2-cb64f385e3a3 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] [instance: 1739cd84-3709-4cf4-95e3-82de4b4d3d7a] Fetching instance by UUID {{(pid=102148) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:35:39.794677 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-a043e738-c77e-49cd-94f2-cb64f385e3a3 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:35:39.795496 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-a043e738-c77e-49cd-94f2-cb64f385e3a3 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:35:39.797372 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-a043e738-c77e-49cd-94f2-cb64f385e3a3 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:35:39.797504 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-a043e738-c77e-49cd-94f2-cb64f385e3a3 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:35:39.832364 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-e72ae4fd-870d-4313-8a1b-d4e2a3b52534 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Calling method '>' {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:35:39.834810 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-e72ae4fd-870d-4313-8a1b-d4e2a3b52534 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] [instance: 2fa4f019-3cbd-4b41-a0fc-6513f46474c0] Fetching instance by UUID {{(pid=102149) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:35:39.852604 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-e72ae4fd-870d-4313-8a1b-d4e2a3b52534 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:35:39.853516 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-e72ae4fd-870d-4313-8a1b-d4e2a3b52534 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:35:39.857230 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-e72ae4fd-870d-4313-8a1b-d4e2a3b52534 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:35:39.857230 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-e72ae4fd-870d-4313-8a1b-d4e2a3b52534 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:35:39.934454 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-e72ae4fd-870d-4313-8a1b-d4e2a3b52534 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] 10.222.0.18 "GET /compute/v2.1/servers/2fa4f019-3cbd-4b41-a0fc-6513f46474c0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.108654 Jun 24 16:35:39.938918 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 180/380] 10.222.0.18 () {58 vars in 1301 bytes} [Fri Jun 24 16:35:39 2022] GET /compute/v2.1/servers/2fa4f019-3cbd-4b41-a0fc-6513f46474c0/os-volume_attachments => generated 197 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 16:35:40.203464 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-a043e738-c77e-49cd-94f2-cb64f385e3a3 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c286a3f03048689e5ec552bb89c161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09584de3a4b14c5a90eb9b1c2149d6fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:35:40.221884 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-a043e738-c77e-49cd-94f2-cb64f385e3a3 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] 10.222.0.18 "GET /compute/v2.1/servers/1739cd84-3709-4cf4-95e3-82de4b4d3d7a" status: 200 len: 1735 microversion: 2.1 time: 0.447460 Jun 24 16:35:40.222575 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 201/381] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:35:39 2022] GET /compute/v2.1/servers/1739cd84-3709-4cf4-95e3-82de4b4d3d7a => generated 1735 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 16:35:40.947575 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-10e65555-1628-4e06-a67c-8aa02601b0f1 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Calling method '>' {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:35:40.948528 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-10e65555-1628-4e06-a67c-8aa02601b0f1 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] [instance: 2fa4f019-3cbd-4b41-a0fc-6513f46474c0] Fetching instance by UUID {{(pid=102149) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:35:40.956137 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-10e65555-1628-4e06-a67c-8aa02601b0f1 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:35:40.956593 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-10e65555-1628-4e06-a67c-8aa02601b0f1 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:35:40.957341 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-10e65555-1628-4e06-a67c-8aa02601b0f1 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:35:40.957798 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-10e65555-1628-4e06-a67c-8aa02601b0f1 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:35:41.028560 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-10e65555-1628-4e06-a67c-8aa02601b0f1 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] 10.222.0.18 "GET /compute/v2.1/servers/2fa4f019-3cbd-4b41-a0fc-6513f46474c0/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.085205 Jun 24 16:35:41.029457 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 181/382] 10.222.0.18 () {58 vars in 1301 bytes} [Fri Jun 24 16:35:40 2022] GET /compute/v2.1/servers/2fa4f019-3cbd-4b41-a0fc-6513f46474c0/os-volume_attachments => generated 25 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jun 24 16:35:41.137215 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-5494b789-7ea5-46de-99e7-ea821293bd59 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Calling method '>' {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:35:41.138030 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-5494b789-7ea5-46de-99e7-ea821293bd59 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] [instance: 2fa4f019-3cbd-4b41-a0fc-6513f46474c0] Fetching instance by UUID {{(pid=102148) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:35:41.148006 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-5494b789-7ea5-46de-99e7-ea821293bd59 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:35:41.148725 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-5494b789-7ea5-46de-99e7-ea821293bd59 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:35:41.150343 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-5494b789-7ea5-46de-99e7-ea821293bd59 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:35:41.150942 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-5494b789-7ea5-46de-99e7-ea821293bd59 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:35:41.218298 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-5494b789-7ea5-46de-99e7-ea821293bd59 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] [instance: 2fa4f019-3cbd-4b41-a0fc-6513f46474c0] Going to try to terminate instance {{(pid=102148) delete /opt/stack/nova/nova/compute/api.py:2562}} Jun 24 16:35:41.241963 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-2f803f59-5f80-434c-a45f-13e19a5d70c5 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Calling method '>' {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:35:41.242575 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-2f803f59-5f80-434c-a45f-13e19a5d70c5 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] [instance: 1739cd84-3709-4cf4-95e3-82de4b4d3d7a] Fetching instance by UUID {{(pid=102149) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:35:41.250537 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-2f803f59-5f80-434c-a45f-13e19a5d70c5 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:35:41.251011 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-2f803f59-5f80-434c-a45f-13e19a5d70c5 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:35:41.251829 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-2f803f59-5f80-434c-a45f-13e19a5d70c5 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:35:41.252504 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-2f803f59-5f80-434c-a45f-13e19a5d70c5 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:35:41.383412 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-5494b789-7ea5-46de-99e7-ea821293bd59 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] 10.222.0.18 "DELETE /compute/v2.1/servers/2fa4f019-3cbd-4b41-a0fc-6513f46474c0" status: 204 len: 0 microversion: 2.1 time: 0.251258 Jun 24 16:35:41.389552 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 202/383] 10.222.0.18 () {58 vars in 1238 bytes} [Fri Jun 24 16:35:41 2022] DELETE /compute/v2.1/servers/2fa4f019-3cbd-4b41-a0fc-6513f46474c0 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 24 16:35:41.396635 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-3e083142-aa2c-47f4-a5a2-93345be9057c tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Calling method '>' {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:35:41.397775 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-3e083142-aa2c-47f4-a5a2-93345be9057c tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] [instance: 2fa4f019-3cbd-4b41-a0fc-6513f46474c0] Fetching instance by UUID {{(pid=102148) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:35:41.413195 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-3e083142-aa2c-47f4-a5a2-93345be9057c tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:35:41.413856 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-3e083142-aa2c-47f4-a5a2-93345be9057c tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:35:41.414813 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-3e083142-aa2c-47f4-a5a2-93345be9057c tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:35:41.415676 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-3e083142-aa2c-47f4-a5a2-93345be9057c tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:35:41.611046 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-2f803f59-5f80-434c-a45f-13e19a5d70c5 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c286a3f03048689e5ec552bb89c161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09584de3a4b14c5a90eb9b1c2149d6fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:35:41.622137 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-2f803f59-5f80-434c-a45f-13e19a5d70c5 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] 10.222.0.18 "GET /compute/v2.1/servers/1739cd84-3709-4cf4-95e3-82de4b4d3d7a" status: 200 len: 1735 microversion: 2.1 time: 0.385233 Jun 24 16:35:41.622586 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 182/384] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:35:41 2022] GET /compute/v2.1/servers/1739cd84-3709-4cf4-95e3-82de4b4d3d7a => generated 1735 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 16:35:41.722595 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-3e083142-aa2c-47f4-a5a2-93345be9057c tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '499faf87cf8c41ae823b2566e4c2d8ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606ba814a2d8408ab0856d539ca79b4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:35:41.732665 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-3e083142-aa2c-47f4-a5a2-93345be9057c tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] 10.222.0.18 "GET /compute/v2.1/servers/2fa4f019-3cbd-4b41-a0fc-6513f46474c0" status: 200 len: 1681 microversion: 2.1 time: 0.341310 Jun 24 16:35:41.733243 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 203/385] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:35:41 2022] GET /compute/v2.1/servers/2fa4f019-3cbd-4b41-a0fc-6513f46474c0 => generated 1681 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 16:35:42.641439 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-fb73301d-fa57-48fe-bfd8-bb983720c955 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Calling method '>' {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:35:42.642164 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-fb73301d-fa57-48fe-bfd8-bb983720c955 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] [instance: 1739cd84-3709-4cf4-95e3-82de4b4d3d7a] Fetching instance by UUID {{(pid=102149) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:35:42.650337 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-fb73301d-fa57-48fe-bfd8-bb983720c955 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:35:42.650814 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-fb73301d-fa57-48fe-bfd8-bb983720c955 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:35:42.651605 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-fb73301d-fa57-48fe-bfd8-bb983720c955 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:35:42.652036 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-fb73301d-fa57-48fe-bfd8-bb983720c955 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:35:42.751142 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-344e0b0a-9820-4edb-95ae-6c2b472cab97 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Calling method '>' {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:35:42.751764 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-344e0b0a-9820-4edb-95ae-6c2b472cab97 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] [instance: 2fa4f019-3cbd-4b41-a0fc-6513f46474c0] Fetching instance by UUID {{(pid=102148) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:35:42.759888 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-344e0b0a-9820-4edb-95ae-6c2b472cab97 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:35:42.760329 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-344e0b0a-9820-4edb-95ae-6c2b472cab97 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:35:42.761097 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-344e0b0a-9820-4edb-95ae-6c2b472cab97 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:35:42.761530 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-344e0b0a-9820-4edb-95ae-6c2b472cab97 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:35:42.935319 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-fb73301d-fa57-48fe-bfd8-bb983720c955 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c286a3f03048689e5ec552bb89c161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09584de3a4b14c5a90eb9b1c2149d6fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:35:42.945845 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-fb73301d-fa57-48fe-bfd8-bb983720c955 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] 10.222.0.18 "GET /compute/v2.1/servers/1739cd84-3709-4cf4-95e3-82de4b4d3d7a" status: 200 len: 1735 microversion: 2.1 time: 0.308950 Jun 24 16:35:42.947366 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 183/386] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:35:42 2022] GET /compute/v2.1/servers/1739cd84-3709-4cf4-95e3-82de4b4d3d7a => generated 1735 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 16:35:43.006483 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-344e0b0a-9820-4edb-95ae-6c2b472cab97 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '499faf87cf8c41ae823b2566e4c2d8ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606ba814a2d8408ab0856d539ca79b4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:35:43.016616 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-344e0b0a-9820-4edb-95ae-6c2b472cab97 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] 10.222.0.18 "GET /compute/v2.1/servers/2fa4f019-3cbd-4b41-a0fc-6513f46474c0" status: 200 len: 1681 microversion: 2.1 time: 0.269585 Jun 24 16:35:43.017191 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 204/387] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:35:42 2022] GET /compute/v2.1/servers/2fa4f019-3cbd-4b41-a0fc-6513f46474c0 => generated 1681 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 16:35:43.969248 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-bd3a846c-8274-4241-9aea-a0201c205a1f tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Calling method '>' {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:35:43.970334 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-bd3a846c-8274-4241-9aea-a0201c205a1f tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] [instance: 1739cd84-3709-4cf4-95e3-82de4b4d3d7a] Fetching instance by UUID {{(pid=102149) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:35:43.983446 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-bd3a846c-8274-4241-9aea-a0201c205a1f tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:35:43.984135 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-bd3a846c-8274-4241-9aea-a0201c205a1f tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:35:43.985431 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-bd3a846c-8274-4241-9aea-a0201c205a1f tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:35:43.986222 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-bd3a846c-8274-4241-9aea-a0201c205a1f tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:35:44.033165 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-333b4869-df0a-4669-bacf-d6858c53009a tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Calling method '>' {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:35:44.033977 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-333b4869-df0a-4669-bacf-d6858c53009a tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] [instance: 2fa4f019-3cbd-4b41-a0fc-6513f46474c0] Fetching instance by UUID {{(pid=102148) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:35:44.043155 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-333b4869-df0a-4669-bacf-d6858c53009a tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:35:44.043903 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-333b4869-df0a-4669-bacf-d6858c53009a tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:35:44.045287 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-333b4869-df0a-4669-bacf-d6858c53009a tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:35:44.045875 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-333b4869-df0a-4669-bacf-d6858c53009a tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:35:44.699150 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-bd3a846c-8274-4241-9aea-a0201c205a1f tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c286a3f03048689e5ec552bb89c161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09584de3a4b14c5a90eb9b1c2149d6fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:35:44.710017 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-bd3a846c-8274-4241-9aea-a0201c205a1f tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] 10.222.0.18 "GET /compute/v2.1/servers/1739cd84-3709-4cf4-95e3-82de4b4d3d7a" status: 200 len: 1735 microversion: 2.1 time: 0.748421 Jun 24 16:35:44.710594 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 184/388] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:35:43 2022] GET /compute/v2.1/servers/1739cd84-3709-4cf4-95e3-82de4b4d3d7a => generated 1735 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 16:35:44.725335 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-333b4869-df0a-4669-bacf-d6858c53009a tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '499faf87cf8c41ae823b2566e4c2d8ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606ba814a2d8408ab0856d539ca79b4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:35:44.741640 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-333b4869-df0a-4669-bacf-d6858c53009a tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] 10.222.0.18 "GET /compute/v2.1/servers/2fa4f019-3cbd-4b41-a0fc-6513f46474c0" status: 200 len: 1681 microversion: 2.1 time: 0.711643 Jun 24 16:35:44.742892 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 205/389] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:35:44 2022] GET /compute/v2.1/servers/2fa4f019-3cbd-4b41-a0fc-6513f46474c0 => generated 1681 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 16:35:45.744736 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-4f2b9d2e-8aae-45e0-88fb-4c478833f0d2 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Calling method '>' {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:35:45.745465 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-4f2b9d2e-8aae-45e0-88fb-4c478833f0d2 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] [instance: 1739cd84-3709-4cf4-95e3-82de4b4d3d7a] Fetching instance by UUID {{(pid=102149) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:35:45.765723 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-931c4f6d-3d69-4b6d-914d-b6f2bd1569fc tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Calling method '>' {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:35:45.766341 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-931c4f6d-3d69-4b6d-914d-b6f2bd1569fc tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] [instance: 2fa4f019-3cbd-4b41-a0fc-6513f46474c0] Fetching instance by UUID {{(pid=102148) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:35:45.768929 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-4f2b9d2e-8aae-45e0-88fb-4c478833f0d2 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:35:45.769570 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-4f2b9d2e-8aae-45e0-88fb-4c478833f0d2 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:35:45.770419 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-4f2b9d2e-8aae-45e0-88fb-4c478833f0d2 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:35:45.775764 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-4f2b9d2e-8aae-45e0-88fb-4c478833f0d2 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:35:45.789469 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-931c4f6d-3d69-4b6d-914d-b6f2bd1569fc tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:35:45.789966 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-931c4f6d-3d69-4b6d-914d-b6f2bd1569fc tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:35:45.790932 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-931c4f6d-3d69-4b6d-914d-b6f2bd1569fc tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:35:45.791435 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-931c4f6d-3d69-4b6d-914d-b6f2bd1569fc tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:35:46.125791 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-931c4f6d-3d69-4b6d-914d-b6f2bd1569fc tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '499faf87cf8c41ae823b2566e4c2d8ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606ba814a2d8408ab0856d539ca79b4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:35:46.138813 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-931c4f6d-3d69-4b6d-914d-b6f2bd1569fc tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] 10.222.0.18 "GET /compute/v2.1/servers/2fa4f019-3cbd-4b41-a0fc-6513f46474c0" status: 200 len: 1614 microversion: 2.1 time: 0.374420 Jun 24 16:35:46.139642 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 206/390] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:35:45 2022] GET /compute/v2.1/servers/2fa4f019-3cbd-4b41-a0fc-6513f46474c0 => generated 1614 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 16:35:46.156913 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [req-eb6eef15-c3c6-4311-b663-491ddc1ebb4e req-5dd594b3-7f89-4836-85ba-c113a698d922 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2fa4f019-3cbd-4b41-a0fc-6513f46474c0", "name": "network-vif-deleted", "tag": "fc075890-b996-4078-bc3c-b93d621d7267"}]} {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 16:35:46.159962 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 24 16:35:46.159962 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: warnings.warn(msg) Jun 24 16:35:46.188779 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [req-eb6eef15-c3c6-4311-b663-491ddc1ebb4e req-5dd594b3-7f89-4836-85ba-c113a698d922 service nova] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:35:46.189515 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [req-eb6eef15-c3c6-4311-b663-491ddc1ebb4e req-5dd594b3-7f89-4836-85ba-c113a698d922 service nova] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:35:46.216829 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-4f2b9d2e-8aae-45e0-88fb-4c478833f0d2 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c286a3f03048689e5ec552bb89c161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09584de3a4b14c5a90eb9b1c2149d6fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:35:46.226368 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-4f2b9d2e-8aae-45e0-88fb-4c478833f0d2 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] 10.222.0.18 "GET /compute/v2.1/servers/1739cd84-3709-4cf4-95e3-82de4b4d3d7a" status: 200 len: 1735 microversion: 2.1 time: 0.485656 Jun 24 16:35:46.228556 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 185/391] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:35:45 2022] GET /compute/v2.1/servers/1739cd84-3709-4cf4-95e3-82de4b4d3d7a => generated 1735 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 16:35:46.249004 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.compute.server_external_events [req-eb6eef15-c3c6-4311-b663-491ddc1ebb4e req-5dd594b3-7f89-4836-85ba-c113a698d922 service nova] Creating event network-vif-deleted:fc075890-b996-4078-bc3c-b93d621d7267 for instance 2fa4f019-3cbd-4b41-a0fc-6513f46474c0 on hv-cinder-84718 Jun 24 16:35:46.257819 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [req-eb6eef15-c3c6-4311-b663-491ddc1ebb4e req-5dd594b3-7f89-4836-85ba-c113a698d922 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.116060 Jun 24 16:35:46.258793 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 207/392] 10.222.0.18 () {64 vars in 1317 bytes} [Fri Jun 24 16:35:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 16:35:47.119195 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-f714be30-adb0-4f75-8131-654ceaec1453 tempest-VolumesSnapshotTestJSON-1294974655 tempest-VolumesSnapshotTestJSON-1294974655-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8a7aaeb6-8c99-4658-8776-844681db380e", "device": "/dev/sdb"}} {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 16:35:47.120757 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-f714be30-adb0-4f75-8131-654ceaec1453 tempest-VolumesSnapshotTestJSON-1294974655 tempest-VolumesSnapshotTestJSON-1294974655-project] [instance: ebd2b19d-ddad-422b-a276-0fb7cbe80753] Fetching instance by UUID {{(pid=102149) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:35:47.128622 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-f714be30-adb0-4f75-8131-654ceaec1453 tempest-VolumesSnapshotTestJSON-1294974655 tempest-VolumesSnapshotTestJSON-1294974655-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:35:47.129441 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-f714be30-adb0-4f75-8131-654ceaec1453 tempest-VolumesSnapshotTestJSON-1294974655 tempest-VolumesSnapshotTestJSON-1294974655-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:35:47.130414 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-f714be30-adb0-4f75-8131-654ceaec1453 tempest-VolumesSnapshotTestJSON-1294974655 tempest-VolumesSnapshotTestJSON-1294974655-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:35:47.130885 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-f714be30-adb0-4f75-8131-654ceaec1453 tempest-VolumesSnapshotTestJSON-1294974655 tempest-VolumesSnapshotTestJSON-1294974655-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:35:47.157176 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-96fceae3-6890-43f2-8813-0d37eeca020b tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Calling method '>' {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:35:47.158601 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-96fceae3-6890-43f2-8813-0d37eeca020b tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] [instance: 2fa4f019-3cbd-4b41-a0fc-6513f46474c0] Fetching instance by UUID {{(pid=102148) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:35:47.167099 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-96fceae3-6890-43f2-8813-0d37eeca020b tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:35:47.167728 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-96fceae3-6890-43f2-8813-0d37eeca020b tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:35:47.168817 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-96fceae3-6890-43f2-8813-0d37eeca020b tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:35:47.169411 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-96fceae3-6890-43f2-8813-0d37eeca020b tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:35:47.224689 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.wsgi [None req-96fceae3-6890-43f2-8813-0d37eeca020b tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] HTTP exception thrown: Instance 2fa4f019-3cbd-4b41-a0fc-6513f46474c0 could not be found. Jun 24 16:35:47.225288 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-96fceae3-6890-43f2-8813-0d37eeca020b tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Returning 404 to user: Instance 2fa4f019-3cbd-4b41-a0fc-6513f46474c0 could not be found. {{(pid=102148) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jun 24 16:35:47.226302 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-96fceae3-6890-43f2-8813-0d37eeca020b tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] 10.222.0.18 "GET /compute/v2.1/servers/2fa4f019-3cbd-4b41-a0fc-6513f46474c0" status: 404 len: 111 microversion: 2.1 time: 0.073415 Jun 24 16:35:47.227377 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 208/393] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:35:47 2022] GET /compute/v2.1/servers/2fa4f019-3cbd-4b41-a0fc-6513f46474c0 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 24 16:35:47.236650 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-791f138c-0dde-4b67-a673-ee0b44f692c6 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Calling method '.version_select at 0x7f1ae8355700>' {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:35:47.263456 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-791f138c-0dde-4b67-a673-ee0b44f692c6 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1345199728" status: 202 len: 0 microversion: 2.1 time: 0.030205 Jun 24 16:35:47.267580 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 209/394] 10.222.0.18 () {58 vars in 1220 bytes} [Fri Jun 24 16:35:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1345199728 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 24 16:35:47.282921 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-68ac5e2a-655a-479c-908d-2896cd4d532f tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Calling method '>' {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:35:47.283860 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-68ac5e2a-655a-479c-908d-2896cd4d532f tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] [instance: 1739cd84-3709-4cf4-95e3-82de4b4d3d7a] Fetching instance by UUID {{(pid=102148) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:35:47.298507 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-68ac5e2a-655a-479c-908d-2896cd4d532f tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:35:47.299636 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-68ac5e2a-655a-479c-908d-2896cd4d532f tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:35:47.300882 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-68ac5e2a-655a-479c-908d-2896cd4d532f tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:35:47.301458 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-68ac5e2a-655a-479c-908d-2896cd4d532f tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:35:47.739784 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-f714be30-adb0-4f75-8131-654ceaec1453 tempest-VolumesSnapshotTestJSON-1294974655 tempest-VolumesSnapshotTestJSON-1294974655-project] 10.222.0.18 "POST /compute/v2.1/servers/ebd2b19d-ddad-422b-a276-0fb7cbe80753/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.621338 Jun 24 16:35:47.740958 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 186/395] 10.222.0.18 () {60 vars in 1322 bytes} [Fri Jun 24 16:35:47 2022] POST /compute/v2.1/servers/ebd2b19d-ddad-422b-a276-0fb7cbe80753/os-volume_attachments => generated 194 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 16:35:47.861013 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-68ac5e2a-655a-479c-908d-2896cd4d532f tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c286a3f03048689e5ec552bb89c161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09584de3a4b14c5a90eb9b1c2149d6fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:35:47.880530 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-68ac5e2a-655a-479c-908d-2896cd4d532f tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] 10.222.0.18 "GET /compute/v2.1/servers/1739cd84-3709-4cf4-95e3-82de4b4d3d7a" status: 200 len: 1735 microversion: 2.1 time: 0.610396 Jun 24 16:35:47.881767 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 210/396] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:35:47 2022] GET /compute/v2.1/servers/1739cd84-3709-4cf4-95e3-82de4b4d3d7a => generated 1735 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 16:35:48.904298 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-ccdd1fcd-a73b-42f7-ace7-80af525ad5ee tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Calling method '>' {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:35:48.905796 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-ccdd1fcd-a73b-42f7-ace7-80af525ad5ee tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] [instance: 1739cd84-3709-4cf4-95e3-82de4b4d3d7a] Fetching instance by UUID {{(pid=102149) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:35:48.921757 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-ccdd1fcd-a73b-42f7-ace7-80af525ad5ee tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:35:48.922504 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-ccdd1fcd-a73b-42f7-ace7-80af525ad5ee tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:35:48.923971 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-ccdd1fcd-a73b-42f7-ace7-80af525ad5ee tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:35:48.924769 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-ccdd1fcd-a73b-42f7-ace7-80af525ad5ee tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:35:49.203949 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-ccdd1fcd-a73b-42f7-ace7-80af525ad5ee tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c286a3f03048689e5ec552bb89c161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09584de3a4b14c5a90eb9b1c2149d6fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:35:49.216276 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-ccdd1fcd-a73b-42f7-ace7-80af525ad5ee tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] 10.222.0.18 "GET /compute/v2.1/servers/1739cd84-3709-4cf4-95e3-82de4b4d3d7a" status: 200 len: 1735 microversion: 2.1 time: 0.319404 Jun 24 16:35:49.217059 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 187/397] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:35:48 2022] GET /compute/v2.1/servers/1739cd84-3709-4cf4-95e3-82de4b4d3d7a => generated 1735 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 16:35:50.022560 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-4bff7d49-2d54-422d-8211-f69e7c4c8166 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Action: 'create', calling method: .version_select at 0x7f1ae8355670>, body: {"keypair": {"name": "tempest-keypair-1633146838", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEaNdezm/m2TWsdl1RoLJLm2Q8D9oX0DvgHqtoA9UtR58T91sTTAAHBRHlXyR/xKMvl0LmlIl9XZ2Wo/XhGrh1iqBZ8j/CXZTndtBRq5ka+Kk3TpZXD19Hn3QItfwCtIUQ=="}} {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 16:35:50.054181 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.quota [None req-4bff7d49-2d54-422d-8211-f69e7c4c8166 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Getting quotas for project 606ba814a2d8408ab0856d539ca79b4f. Resources: {'key_pairs'} {{(pid=102148) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jun 24 16:35:50.065845 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.quota [None req-4bff7d49-2d54-422d-8211-f69e7c4c8166 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Getting quotas for user 499faf87cf8c41ae823b2566e4c2d8ce and project 606ba814a2d8408ab0856d539ca79b4f. Resources: {'key_pairs'} {{(pid=102148) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jun 24 16:35:50.112496 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-4bff7d49-2d54-422d-8211-f69e7c4c8166 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.094041 Jun 24 16:35:50.116799 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 211/398] 10.222.0.18 () {60 vars in 1158 bytes} [Fri Jun 24 16:35:50 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 16:35:50.243785 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-4a767214-69cc-4e92-9fce-dee0f1808d52 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Calling method '>' {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:35:50.245374 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-4a767214-69cc-4e92-9fce-dee0f1808d52 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] [instance: 1739cd84-3709-4cf4-95e3-82de4b4d3d7a] Fetching instance by UUID {{(pid=102149) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:35:50.261185 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-4a767214-69cc-4e92-9fce-dee0f1808d52 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:35:50.261957 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-4a767214-69cc-4e92-9fce-dee0f1808d52 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:35:50.263395 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-4a767214-69cc-4e92-9fce-dee0f1808d52 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:35:50.264336 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-4a767214-69cc-4e92-9fce-dee0f1808d52 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:35:50.708956 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-4a767214-69cc-4e92-9fce-dee0f1808d52 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c286a3f03048689e5ec552bb89c161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09584de3a4b14c5a90eb9b1c2149d6fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:35:50.730311 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-4a767214-69cc-4e92-9fce-dee0f1808d52 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] 10.222.0.18 "GET /compute/v2.1/servers/1739cd84-3709-4cf4-95e3-82de4b4d3d7a" status: 200 len: 1735 microversion: 2.1 time: 0.493181 Jun 24 16:35:50.749569 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 188/399] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:35:50 2022] GET /compute/v2.1/servers/1739cd84-3709-4cf4-95e3-82de4b4d3d7a => generated 1735 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 16:35:51.760687 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-f50f8a0c-fc81-47f5-adc5-0f134597ccff tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Calling method '>' {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:35:51.761871 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-f50f8a0c-fc81-47f5-adc5-0f134597ccff tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] [instance: 1739cd84-3709-4cf4-95e3-82de4b4d3d7a] Fetching instance by UUID {{(pid=102148) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:35:51.778839 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-f50f8a0c-fc81-47f5-adc5-0f134597ccff tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:35:51.780046 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-f50f8a0c-fc81-47f5-adc5-0f134597ccff tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:35:51.781872 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-f50f8a0c-fc81-47f5-adc5-0f134597ccff tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:35:51.783351 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-f50f8a0c-fc81-47f5-adc5-0f134597ccff tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:35:52.218182 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-f50f8a0c-fc81-47f5-adc5-0f134597ccff tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c286a3f03048689e5ec552bb89c161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09584de3a4b14c5a90eb9b1c2149d6fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:35:52.235544 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-f50f8a0c-fc81-47f5-adc5-0f134597ccff tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] 10.222.0.18 "GET /compute/v2.1/servers/1739cd84-3709-4cf4-95e3-82de4b4d3d7a" status: 200 len: 1735 microversion: 2.1 time: 0.482378 Jun 24 16:35:52.236132 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 212/400] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:35:51 2022] GET /compute/v2.1/servers/1739cd84-3709-4cf4-95e3-82de4b4d3d7a => generated 1735 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 16:35:53.067955 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-f8d96e60-c7c2-4f68-b5b5-9bdddf7a44e2 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1552779867", "imageRef": "113c9cfb-6cee-4018-9e63-66fae82b3851", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "45be4882-d29a-4ee7-b3ed-ba8729666ff7"}], "security_groups": [{"name": "tempest-securitygroup--1583702791"}], "key_name": "tempest-keypair-1633146838", "user_data": "}} {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 16:35:53.261806 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-6f1895f6-5664-4a19-b576-b9462a19c39d tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Calling method '>' {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:35:53.264403 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-6f1895f6-5664-4a19-b576-b9462a19c39d tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] [instance: 1739cd84-3709-4cf4-95e3-82de4b4d3d7a] Fetching instance by UUID {{(pid=102148) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:35:53.280925 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.network.neutron [None req-f8d96e60-c7c2-4f68-b5b5-9bdddf7a44e2 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] validate_networks() for [('45be4882-d29a-4ee7-b3ed-ba8729666ff7', None, None, None)] {{(pid=102149) validate_networks /opt/stack/nova/nova/network/neutron.py:2367}} Jun 24 16:35:53.286476 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-6f1895f6-5664-4a19-b576-b9462a19c39d tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:35:53.287645 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-6f1895f6-5664-4a19-b576-b9462a19c39d tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:35:53.289349 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-6f1895f6-5664-4a19-b576-b9462a19c39d tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:35:53.290178 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-6f1895f6-5664-4a19-b576-b9462a19c39d tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:35:53.859226 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-6f1895f6-5664-4a19-b576-b9462a19c39d tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c286a3f03048689e5ec552bb89c161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09584de3a4b14c5a90eb9b1c2149d6fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:35:53.890677 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-6f1895f6-5664-4a19-b576-b9462a19c39d tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] 10.222.0.18 "GET /compute/v2.1/servers/1739cd84-3709-4cf4-95e3-82de4b4d3d7a" status: 200 len: 1735 microversion: 2.1 time: 0.638351 Jun 24 16:35:53.892683 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 213/401] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:35:53 2022] GET /compute/v2.1/servers/1739cd84-3709-4cf4-95e3-82de4b4d3d7a => generated 1735 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 16:35:54.260696 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.virt.hardware [None req-f8d96e60-c7c2-4f68-b5b5-9bdddf7a44e2 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Flavor limits 0:0:0 {{(pid=102149) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 24 16:35:54.261216 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.virt.hardware [None req-f8d96e60-c7c2-4f68-b5b5-9bdddf7a44e2 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Image limits 0:0:0 {{(pid=102149) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 24 16:35:54.261428 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.virt.hardware [None req-f8d96e60-c7c2-4f68-b5b5-9bdddf7a44e2 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Flavor pref 0:0:0 {{(pid=102149) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 24 16:35:54.261840 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.virt.hardware [None req-f8d96e60-c7c2-4f68-b5b5-9bdddf7a44e2 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Image pref 0:0:0 {{(pid=102149) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 24 16:35:54.262282 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.virt.hardware [None req-f8d96e60-c7c2-4f68-b5b5-9bdddf7a44e2 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=102149) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 24 16:35:54.273415 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-f8d96e60-c7c2-4f68-b5b5-9bdddf7a44e2 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:35:54.273867 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-f8d96e60-c7c2-4f68-b5b5-9bdddf7a44e2 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:35:54.274740 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-f8d96e60-c7c2-4f68-b5b5-9bdddf7a44e2 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:35:54.275195 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-f8d96e60-c7c2-4f68-b5b5-9bdddf7a44e2 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:35:54.297475 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.quota [None req-f8d96e60-c7c2-4f68-b5b5-9bdddf7a44e2 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Getting quotas for project 606ba814a2d8408ab0856d539ca79b4f. Resources: {'ram', 'instances', 'cores'} {{(pid=102149) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jun 24 16:35:54.302096 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.quota [None req-f8d96e60-c7c2-4f68-b5b5-9bdddf7a44e2 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Getting quotas for user 499faf87cf8c41ae823b2566e4c2d8ce and project 606ba814a2d8408ab0856d539ca79b4f. Resources: {'ram', 'instances', 'cores'} {{(pid=102149) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jun 24 16:35:54.344513 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-f8d96e60-c7c2-4f68-b5b5-9bdddf7a44e2 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Going to run 1 instances... {{(pid=102149) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Jun 24 16:35:54.352460 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-f8d96e60-c7c2-4f68-b5b5-9bdddf7a44e2 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] [instance: 41c16116-97cf-4394-8c41-2d57d447d422] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='113c9cfb-6cee-4018-9e63-66fae82b3851',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=102149) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1684}} Jun 24 16:35:54.461165 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-f8d96e60-c7c2-4f68-b5b5-9bdddf7a44e2 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.397717 Jun 24 16:35:54.462727 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 189/402] 10.222.0.18 () {60 vars in 1146 bytes} [Fri Jun 24 16:35:53 2022] POST /compute/v2.1/servers => generated 402 bytes in 1400 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 24 16:35:54.473152 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-21817a82-e9b9-430c-a44e-091b731cb25d tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Calling method '>' {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:35:54.474856 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-21817a82-e9b9-430c-a44e-091b731cb25d tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] [instance: 41c16116-97cf-4394-8c41-2d57d447d422] Fetching instance by UUID {{(pid=102148) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:35:54.595111 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-21817a82-e9b9-430c-a44e-091b731cb25d tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '499faf87cf8c41ae823b2566e4c2d8ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606ba814a2d8408ab0856d539ca79b4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:35:54.607720 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-21817a82-e9b9-430c-a44e-091b731cb25d tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] 10.222.0.18 "GET /compute/v2.1/servers/41c16116-97cf-4394-8c41-2d57d447d422" status: 200 len: 1242 microversion: 2.1 time: 0.138512 Jun 24 16:35:54.619409 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 214/403] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:35:54 2022] GET /compute/v2.1/servers/41c16116-97cf-4394-8c41-2d57d447d422 => generated 1242 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 16:35:54.914043 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-2290bc67-8ca1-4c92-894d-151e52f842da tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Calling method '>' {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:35:54.914780 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-2290bc67-8ca1-4c92-894d-151e52f842da tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] [instance: 1739cd84-3709-4cf4-95e3-82de4b4d3d7a] Fetching instance by UUID {{(pid=102149) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:35:54.926183 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-2290bc67-8ca1-4c92-894d-151e52f842da tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:35:54.927172 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-2290bc67-8ca1-4c92-894d-151e52f842da tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:35:54.928541 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-2290bc67-8ca1-4c92-894d-151e52f842da tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:35:54.929619 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-2290bc67-8ca1-4c92-894d-151e52f842da tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:35:55.330587 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-2290bc67-8ca1-4c92-894d-151e52f842da tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c286a3f03048689e5ec552bb89c161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09584de3a4b14c5a90eb9b1c2149d6fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:35:55.341763 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-2290bc67-8ca1-4c92-894d-151e52f842da tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] 10.222.0.18 "GET /compute/v2.1/servers/1739cd84-3709-4cf4-95e3-82de4b4d3d7a" status: 200 len: 1735 microversion: 2.1 time: 0.431348 Jun 24 16:35:55.352164 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 190/404] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:35:54 2022] GET /compute/v2.1/servers/1739cd84-3709-4cf4-95e3-82de4b4d3d7a => generated 1735 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 16:35:55.633105 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-cc7f0edd-ef21-4f99-9180-e72c477a9030 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Calling method '>' {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:35:55.635305 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-cc7f0edd-ef21-4f99-9180-e72c477a9030 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] [instance: 41c16116-97cf-4394-8c41-2d57d447d422] Fetching instance by UUID {{(pid=102148) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:35:55.656627 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-cc7f0edd-ef21-4f99-9180-e72c477a9030 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:35:55.657974 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-cc7f0edd-ef21-4f99-9180-e72c477a9030 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:35:55.659749 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-cc7f0edd-ef21-4f99-9180-e72c477a9030 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:35:55.660642 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-cc7f0edd-ef21-4f99-9180-e72c477a9030 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:35:56.011275 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-cc7f0edd-ef21-4f99-9180-e72c477a9030 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '499faf87cf8c41ae823b2566e4c2d8ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606ba814a2d8408ab0856d539ca79b4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:35:56.051838 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-cc7f0edd-ef21-4f99-9180-e72c477a9030 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] 10.222.0.18 "GET /compute/v2.1/servers/41c16116-97cf-4394-8c41-2d57d447d422" status: 200 len: 1294 microversion: 2.1 time: 0.425759 Jun 24 16:35:56.055045 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 215/405] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:35:55 2022] GET /compute/v2.1/servers/41c16116-97cf-4394-8c41-2d57d447d422 => generated 1294 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 16:35:56.367482 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-5e12ac2a-a9f0-419a-8acc-36497a3f577b tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Calling method '>' {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:35:56.372956 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-5e12ac2a-a9f0-419a-8acc-36497a3f577b tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] [instance: 1739cd84-3709-4cf4-95e3-82de4b4d3d7a] Fetching instance by UUID {{(pid=102149) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:35:56.424053 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-5e12ac2a-a9f0-419a-8acc-36497a3f577b tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:35:56.425184 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-5e12ac2a-a9f0-419a-8acc-36497a3f577b tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:35:56.429771 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-5e12ac2a-a9f0-419a-8acc-36497a3f577b tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:35:56.435111 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-5e12ac2a-a9f0-419a-8acc-36497a3f577b tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:35:57.079875 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-81303347-5715-4b1c-9ca6-f103bbc932f2 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Calling method '>' {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:35:57.081293 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-81303347-5715-4b1c-9ca6-f103bbc932f2 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] [instance: 41c16116-97cf-4394-8c41-2d57d447d422] Fetching instance by UUID {{(pid=102148) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:35:57.099215 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-81303347-5715-4b1c-9ca6-f103bbc932f2 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:35:57.100403 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-81303347-5715-4b1c-9ca6-f103bbc932f2 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:35:57.102833 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-81303347-5715-4b1c-9ca6-f103bbc932f2 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:35:57.103999 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-81303347-5715-4b1c-9ca6-f103bbc932f2 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:35:57.177176 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-5e12ac2a-a9f0-419a-8acc-36497a3f577b tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c286a3f03048689e5ec552bb89c161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09584de3a4b14c5a90eb9b1c2149d6fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:35:57.198438 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-5e12ac2a-a9f0-419a-8acc-36497a3f577b tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] 10.222.0.18 "GET /compute/v2.1/servers/1739cd84-3709-4cf4-95e3-82de4b4d3d7a" status: 200 len: 1735 microversion: 2.1 time: 0.840293 Jun 24 16:35:57.218427 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 191/406] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:35:56 2022] GET /compute/v2.1/servers/1739cd84-3709-4cf4-95e3-82de4b4d3d7a => generated 1735 bytes in 862 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 16:35:57.365111 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-81303347-5715-4b1c-9ca6-f103bbc932f2 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '499faf87cf8c41ae823b2566e4c2d8ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606ba814a2d8408ab0856d539ca79b4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:35:57.387978 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-81303347-5715-4b1c-9ca6-f103bbc932f2 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] 10.222.0.18 "GET /compute/v2.1/servers/41c16116-97cf-4394-8c41-2d57d447d422" status: 200 len: 1300 microversion: 2.1 time: 0.312259 Jun 24 16:35:57.401065 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 216/407] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:35:57 2022] GET /compute/v2.1/servers/41c16116-97cf-4394-8c41-2d57d447d422 => generated 1300 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 16:35:58.223901 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-c3017911-0a30-43d6-824e-71c717e30c97 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Calling method '>' {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:35:58.224707 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-c3017911-0a30-43d6-824e-71c717e30c97 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] [instance: 1739cd84-3709-4cf4-95e3-82de4b4d3d7a] Fetching instance by UUID {{(pid=102149) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:35:58.239405 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-c3017911-0a30-43d6-824e-71c717e30c97 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:35:58.240116 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-c3017911-0a30-43d6-824e-71c717e30c97 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:35:58.241373 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-c3017911-0a30-43d6-824e-71c717e30c97 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:35:58.242201 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-c3017911-0a30-43d6-824e-71c717e30c97 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:35:58.410399 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-5a02dfce-97a8-43a9-9002-45ee0953845a tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Calling method '>' {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:35:58.411340 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-5a02dfce-97a8-43a9-9002-45ee0953845a tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] [instance: 41c16116-97cf-4394-8c41-2d57d447d422] Fetching instance by UUID {{(pid=102148) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:35:58.428227 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-5a02dfce-97a8-43a9-9002-45ee0953845a tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:35:58.428777 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-5a02dfce-97a8-43a9-9002-45ee0953845a tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:35:58.429641 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-5a02dfce-97a8-43a9-9002-45ee0953845a tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:35:58.430751 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-5a02dfce-97a8-43a9-9002-45ee0953845a tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:35:58.983966 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-c3017911-0a30-43d6-824e-71c717e30c97 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c286a3f03048689e5ec552bb89c161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09584de3a4b14c5a90eb9b1c2149d6fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:35:59.017136 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-c3017911-0a30-43d6-824e-71c717e30c97 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] 10.222.0.18 "GET /compute/v2.1/servers/1739cd84-3709-4cf4-95e3-82de4b4d3d7a" status: 200 len: 1735 microversion: 2.1 time: 0.796930 Jun 24 16:35:59.039755 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 192/408] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:35:58 2022] GET /compute/v2.1/servers/1739cd84-3709-4cf4-95e3-82de4b4d3d7a => generated 1735 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 16:35:59.117955 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-5a02dfce-97a8-43a9-9002-45ee0953845a tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '499faf87cf8c41ae823b2566e4c2d8ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606ba814a2d8408ab0856d539ca79b4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:35:59.140229 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-5a02dfce-97a8-43a9-9002-45ee0953845a tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] 10.222.0.18 "GET /compute/v2.1/servers/41c16116-97cf-4394-8c41-2d57d447d422" status: 200 len: 1368 microversion: 2.1 time: 0.734308 Jun 24 16:35:59.142420 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 217/409] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:35:58 2022] GET /compute/v2.1/servers/41c16116-97cf-4394-8c41-2d57d447d422 => generated 1368 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 16:36:00.051027 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-b7ebca33-43ed-4141-be2e-545f468a49d1 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Calling method '>' {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:36:00.052126 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-b7ebca33-43ed-4141-be2e-545f468a49d1 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] [instance: 1739cd84-3709-4cf4-95e3-82de4b4d3d7a] Fetching instance by UUID {{(pid=102149) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:36:00.067481 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-b7ebca33-43ed-4141-be2e-545f468a49d1 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:36:00.068379 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-b7ebca33-43ed-4141-be2e-545f468a49d1 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:36:00.069663 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-b7ebca33-43ed-4141-be2e-545f468a49d1 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:36:00.070476 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-b7ebca33-43ed-4141-be2e-545f468a49d1 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:36:00.175200 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-2f55bf21-0253-4621-8c40-31927755c20a tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Calling method '>' {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:36:00.176314 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-2f55bf21-0253-4621-8c40-31927755c20a tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] [instance: 41c16116-97cf-4394-8c41-2d57d447d422] Fetching instance by UUID {{(pid=102148) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:36:00.213729 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-2f55bf21-0253-4621-8c40-31927755c20a tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:36:00.214507 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-2f55bf21-0253-4621-8c40-31927755c20a tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:36:00.222070 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-2f55bf21-0253-4621-8c40-31927755c20a tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:36:00.223002 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-2f55bf21-0253-4621-8c40-31927755c20a tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:36:01.335132 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-2f55bf21-0253-4621-8c40-31927755c20a tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '499faf87cf8c41ae823b2566e4c2d8ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606ba814a2d8408ab0856d539ca79b4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:36:01.336246 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-b7ebca33-43ed-4141-be2e-545f468a49d1 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c286a3f03048689e5ec552bb89c161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09584de3a4b14c5a90eb9b1c2149d6fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:36:01.356125 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-2f55bf21-0253-4621-8c40-31927755c20a tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] 10.222.0.18 "GET /compute/v2.1/servers/41c16116-97cf-4394-8c41-2d57d447d422" status: 200 len: 1368 microversion: 2.1 time: 1.189449 Jun 24 16:36:01.358141 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 218/410] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:36:00 2022] GET /compute/v2.1/servers/41c16116-97cf-4394-8c41-2d57d447d422 => generated 1368 bytes in 1193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 16:36:01.360345 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-b7ebca33-43ed-4141-be2e-545f468a49d1 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] 10.222.0.18 "GET /compute/v2.1/servers/1739cd84-3709-4cf4-95e3-82de4b4d3d7a" status: 200 len: 1735 microversion: 2.1 time: 1.316069 Jun 24 16:36:01.374740 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 193/411] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:36:00 2022] GET /compute/v2.1/servers/1739cd84-3709-4cf4-95e3-82de4b4d3d7a => generated 1735 bytes in 1319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 16:36:02.249180 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [req-eee26658-0acf-490f-b814-0a23cbc64be8 req-1c91af9e-b4d2-4479-905f-454e408a12a7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "41c16116-97cf-4394-8c41-2d57d447d422", "tag": "6ccb72c8-72c5-4467-a284-d1c79d49c232"}]} {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 16:36:02.251534 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 24 16:36:02.251534 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: warnings.warn(msg) Jun 24 16:36:02.282512 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [req-eee26658-0acf-490f-b814-0a23cbc64be8 req-1c91af9e-b4d2-4479-905f-454e408a12a7 service nova] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:36:02.284786 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [req-eee26658-0acf-490f-b814-0a23cbc64be8 req-1c91af9e-b4d2-4479-905f-454e408a12a7 service nova] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:36:02.328988 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.compute.server_external_events [req-eee26658-0acf-490f-b814-0a23cbc64be8 req-1c91af9e-b4d2-4479-905f-454e408a12a7 service nova] Creating event network-changed:6ccb72c8-72c5-4467-a284-d1c79d49c232 for instance 41c16116-97cf-4394-8c41-2d57d447d422 on hv-cinder-84718 Jun 24 16:36:02.348011 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [req-eee26658-0acf-490f-b814-0a23cbc64be8 req-1c91af9e-b4d2-4479-905f-454e408a12a7 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.102901 Jun 24 16:36:02.354194 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 219/412] 10.222.0.18 () {64 vars in 1317 bytes} [Fri Jun 24 16:36:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 16:36:02.377963 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-24e39af3-1c76-4e6e-b411-d5757b082b48 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Calling method '>' {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:36:02.381259 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-24e39af3-1c76-4e6e-b411-d5757b082b48 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] [instance: 41c16116-97cf-4394-8c41-2d57d447d422] Fetching instance by UUID {{(pid=102149) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:36:02.387906 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-40ae9f69-3471-4bb1-a2d0-061b43bbf6c6 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Calling method '>' {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:36:02.388916 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-40ae9f69-3471-4bb1-a2d0-061b43bbf6c6 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] [instance: 1739cd84-3709-4cf4-95e3-82de4b4d3d7a] Fetching instance by UUID {{(pid=102148) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:36:02.411862 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-40ae9f69-3471-4bb1-a2d0-061b43bbf6c6 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:36:02.412649 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-40ae9f69-3471-4bb1-a2d0-061b43bbf6c6 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:36:02.414025 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-40ae9f69-3471-4bb1-a2d0-061b43bbf6c6 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:36:02.415919 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-24e39af3-1c76-4e6e-b411-d5757b082b48 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:36:02.417307 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-24e39af3-1c76-4e6e-b411-d5757b082b48 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:36:02.420961 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-24e39af3-1c76-4e6e-b411-d5757b082b48 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:36:02.424840 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-24e39af3-1c76-4e6e-b411-d5757b082b48 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:36:02.425685 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-40ae9f69-3471-4bb1-a2d0-061b43bbf6c6 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:36:03.144484 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-24e39af3-1c76-4e6e-b411-d5757b082b48 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '499faf87cf8c41ae823b2566e4c2d8ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606ba814a2d8408ab0856d539ca79b4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:36:03.157390 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-24e39af3-1c76-4e6e-b411-d5757b082b48 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] 10.222.0.18 "GET /compute/v2.1/servers/41c16116-97cf-4394-8c41-2d57d447d422" status: 200 len: 1368 microversion: 2.1 time: 0.786226 Jun 24 16:36:03.159661 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 194/413] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:36:02 2022] GET /compute/v2.1/servers/41c16116-97cf-4394-8c41-2d57d447d422 => generated 1368 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 16:36:03.163869 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-40ae9f69-3471-4bb1-a2d0-061b43bbf6c6 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c286a3f03048689e5ec552bb89c161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09584de3a4b14c5a90eb9b1c2149d6fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:36:03.176025 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-40ae9f69-3471-4bb1-a2d0-061b43bbf6c6 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] 10.222.0.18 "GET /compute/v2.1/servers/1739cd84-3709-4cf4-95e3-82de4b4d3d7a" status: 200 len: 1715 microversion: 2.1 time: 0.793787 Jun 24 16:36:03.187659 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 220/414] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:36:02 2022] GET /compute/v2.1/servers/1739cd84-3709-4cf4-95e3-82de4b4d3d7a => generated 1715 bytes in 807 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 16:36:03.512004 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-4098c1f6-c54d-4edc-9c73-8b459886cd70 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Calling method '>' {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:36:03.513100 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-4098c1f6-c54d-4edc-9c73-8b459886cd70 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] [instance: 1739cd84-3709-4cf4-95e3-82de4b4d3d7a] Fetching instance by UUID {{(pid=102149) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:36:03.530524 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-4098c1f6-c54d-4edc-9c73-8b459886cd70 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:36:03.531972 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-4098c1f6-c54d-4edc-9c73-8b459886cd70 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:36:03.532994 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-4098c1f6-c54d-4edc-9c73-8b459886cd70 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:36:03.533607 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-4098c1f6-c54d-4edc-9c73-8b459886cd70 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:36:03.892341 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.wsgi [None req-4098c1f6-c54d-4edc-9c73-8b459886cd70 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] HTTP exception thrown: Cannot 'detach_volume' instance 1739cd84-3709-4cf4-95e3-82de4b4d3d7a while it is in vm_state rescued Jun 24 16:36:03.892954 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-4098c1f6-c54d-4edc-9c73-8b459886cd70 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Returning 409 to user: Cannot 'detach_volume' instance 1739cd84-3709-4cf4-95e3-82de4b4d3d7a while it is in vm_state rescued {{(pid=102149) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jun 24 16:36:03.893789 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-4098c1f6-c54d-4edc-9c73-8b459886cd70 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] 10.222.0.18 "DELETE /compute/v2.1/servers/1739cd84-3709-4cf4-95e3-82de4b4d3d7a/os-volume_attachments/5f9484b2-a8b8-44e8-9f61-276808d424fa" status: 409 len: 152 microversion: 2.1 time: 0.386724 Jun 24 16:36:03.897458 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 195/415] 10.222.0.18 () {58 vars in 1415 bytes} [Fri Jun 24 16:36:03 2022] DELETE /compute/v2.1/servers/1739cd84-3709-4cf4-95e3-82de4b4d3d7a/os-volume_attachments/5f9484b2-a8b8-44e8-9f61-276808d424fa => generated 152 bytes in 391 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jun 24 16:36:03.912244 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-334172e4-2783-4504-a4d3-fb4499d71d8d tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 16:36:03.914371 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-334172e4-2783-4504-a4d3-fb4499d71d8d tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] [instance: 1739cd84-3709-4cf4-95e3-82de4b4d3d7a] Fetching instance by UUID {{(pid=102148) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:36:03.943148 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-334172e4-2783-4504-a4d3-fb4499d71d8d tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:36:03.944135 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-334172e4-2783-4504-a4d3-fb4499d71d8d tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:36:03.945478 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-334172e4-2783-4504-a4d3-fb4499d71d8d tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:36:03.946774 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-334172e4-2783-4504-a4d3-fb4499d71d8d tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:36:04.182216 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-5f4775b0-9b47-4031-8f75-f77536ad2b9c tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Calling method '>' {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:36:04.183230 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-5f4775b0-9b47-4031-8f75-f77536ad2b9c tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] [instance: 41c16116-97cf-4394-8c41-2d57d447d422] Fetching instance by UUID {{(pid=102149) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:36:04.200297 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-5f4775b0-9b47-4031-8f75-f77536ad2b9c tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:36:04.201195 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-5f4775b0-9b47-4031-8f75-f77536ad2b9c tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:36:04.202174 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-5f4775b0-9b47-4031-8f75-f77536ad2b9c tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:36:04.202621 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-5f4775b0-9b47-4031-8f75-f77536ad2b9c tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:36:04.277480 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-334172e4-2783-4504-a4d3-fb4499d71d8d tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] 10.222.0.18 "POST /compute/v2.1/servers/1739cd84-3709-4cf4-95e3-82de4b4d3d7a/action" status: 202 len: 0 microversion: 2.1 time: 0.374782 Jun 24 16:36:04.280307 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 221/416] 10.222.0.18 () {60 vars in 1277 bytes} [Fri Jun 24 16:36:03 2022] POST /compute/v2.1/servers/1739cd84-3709-4cf4-95e3-82de4b4d3d7a/action => generated 0 bytes in 379 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 24 16:36:04.296817 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-4e123d8e-1f5e-476c-82a3-321d584de9ab tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Calling method '>' {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:36:04.298429 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-4e123d8e-1f5e-476c-82a3-321d584de9ab tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] [instance: 1739cd84-3709-4cf4-95e3-82de4b4d3d7a] Fetching instance by UUID {{(pid=102148) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:36:04.337448 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-4e123d8e-1f5e-476c-82a3-321d584de9ab tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:36:04.338278 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-4e123d8e-1f5e-476c-82a3-321d584de9ab tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:36:04.354811 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-4e123d8e-1f5e-476c-82a3-321d584de9ab tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:36:04.356294 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-4e123d8e-1f5e-476c-82a3-321d584de9ab tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:36:04.998330 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-5f4775b0-9b47-4031-8f75-f77536ad2b9c tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '499faf87cf8c41ae823b2566e4c2d8ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606ba814a2d8408ab0856d539ca79b4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:36:05.025670 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-4e123d8e-1f5e-476c-82a3-321d584de9ab tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c286a3f03048689e5ec552bb89c161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09584de3a4b14c5a90eb9b1c2149d6fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:36:05.044418 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-4e123d8e-1f5e-476c-82a3-321d584de9ab tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] 10.222.0.18 "GET /compute/v2.1/servers/1739cd84-3709-4cf4-95e3-82de4b4d3d7a" status: 200 len: 1723 microversion: 2.1 time: 0.753601 Jun 24 16:36:05.045073 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 222/417] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:36:04 2022] GET /compute/v2.1/servers/1739cd84-3709-4cf4-95e3-82de4b4d3d7a => generated 1723 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 16:36:05.055109 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-5f4775b0-9b47-4031-8f75-f77536ad2b9c tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] 10.222.0.18 "GET /compute/v2.1/servers/41c16116-97cf-4394-8c41-2d57d447d422" status: 200 len: 1368 microversion: 2.1 time: 0.868639 Jun 24 16:36:05.055109 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 196/418] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:36:04 2022] GET /compute/v2.1/servers/41c16116-97cf-4394-8c41-2d57d447d422 => generated 1368 bytes in 872 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 16:36:06.073731 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-f7193247-f78e-4bc1-8b4b-f95339d4a9f9 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Calling method '>' {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:36:06.076922 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-b65d9701-f470-4878-82bd-c70980d03773 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Calling method '>' {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:36:06.078874 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-f7193247-f78e-4bc1-8b4b-f95339d4a9f9 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] [instance: 41c16116-97cf-4394-8c41-2d57d447d422] Fetching instance by UUID {{(pid=102148) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:36:06.080614 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-b65d9701-f470-4878-82bd-c70980d03773 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] [instance: 1739cd84-3709-4cf4-95e3-82de4b4d3d7a] Fetching instance by UUID {{(pid=102149) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:36:06.111471 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-b65d9701-f470-4878-82bd-c70980d03773 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:36:06.112928 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-f7193247-f78e-4bc1-8b4b-f95339d4a9f9 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:36:06.114081 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-f7193247-f78e-4bc1-8b4b-f95339d4a9f9 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:36:06.115954 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-f7193247-f78e-4bc1-8b4b-f95339d4a9f9 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:36:06.117303 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-b65d9701-f470-4878-82bd-c70980d03773 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:36:06.119514 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-f7193247-f78e-4bc1-8b4b-f95339d4a9f9 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:36:06.121008 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-b65d9701-f470-4878-82bd-c70980d03773 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:36:06.125438 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-b65d9701-f470-4878-82bd-c70980d03773 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:36:06.533538 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-f7193247-f78e-4bc1-8b4b-f95339d4a9f9 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '499faf87cf8c41ae823b2566e4c2d8ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606ba814a2d8408ab0856d539ca79b4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:36:06.545059 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-f7193247-f78e-4bc1-8b4b-f95339d4a9f9 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] 10.222.0.18 "GET /compute/v2.1/servers/41c16116-97cf-4394-8c41-2d57d447d422" status: 200 len: 1368 microversion: 2.1 time: 0.483208 Jun 24 16:36:06.545926 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 223/419] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:36:06 2022] GET /compute/v2.1/servers/41c16116-97cf-4394-8c41-2d57d447d422 => generated 1368 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 16:36:06.595638 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-b65d9701-f470-4878-82bd-c70980d03773 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c286a3f03048689e5ec552bb89c161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09584de3a4b14c5a90eb9b1c2149d6fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:36:06.607105 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-b65d9701-f470-4878-82bd-c70980d03773 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] 10.222.0.18 "GET /compute/v2.1/servers/1739cd84-3709-4cf4-95e3-82de4b4d3d7a" status: 200 len: 1723 microversion: 2.1 time: 0.546691 Jun 24 16:36:06.608002 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 197/420] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:36:06 2022] GET /compute/v2.1/servers/1739cd84-3709-4cf4-95e3-82de4b4d3d7a => generated 1723 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 16:36:07.570398 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-07052fd8-5f39-428f-8b8e-0054ca4624b5 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Calling method '>' {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:36:07.571835 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-07052fd8-5f39-428f-8b8e-0054ca4624b5 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] [instance: 41c16116-97cf-4394-8c41-2d57d447d422] Fetching instance by UUID {{(pid=102148) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:36:07.580160 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-07052fd8-5f39-428f-8b8e-0054ca4624b5 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:36:07.580883 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-07052fd8-5f39-428f-8b8e-0054ca4624b5 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:36:07.582001 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-07052fd8-5f39-428f-8b8e-0054ca4624b5 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:36:07.582759 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-07052fd8-5f39-428f-8b8e-0054ca4624b5 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:36:07.629969 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-bf7b5f37-e9e9-4641-9a39-5cbd17c7ad4f tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Calling method '>' {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:36:07.633702 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-bf7b5f37-e9e9-4641-9a39-5cbd17c7ad4f tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] [instance: 1739cd84-3709-4cf4-95e3-82de4b4d3d7a] Fetching instance by UUID {{(pid=102149) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:36:07.642592 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-bf7b5f37-e9e9-4641-9a39-5cbd17c7ad4f tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:36:07.643827 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-bf7b5f37-e9e9-4641-9a39-5cbd17c7ad4f tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:36:07.645073 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-bf7b5f37-e9e9-4641-9a39-5cbd17c7ad4f tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:36:07.645795 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-bf7b5f37-e9e9-4641-9a39-5cbd17c7ad4f tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:36:08.013425 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-bf7b5f37-e9e9-4641-9a39-5cbd17c7ad4f tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c286a3f03048689e5ec552bb89c161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09584de3a4b14c5a90eb9b1c2149d6fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:36:08.024880 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-bf7b5f37-e9e9-4641-9a39-5cbd17c7ad4f tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] 10.222.0.18 "GET /compute/v2.1/servers/1739cd84-3709-4cf4-95e3-82de4b4d3d7a" status: 200 len: 1723 microversion: 2.1 time: 0.402817 Jun 24 16:36:08.025649 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 198/421] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:36:07 2022] GET /compute/v2.1/servers/1739cd84-3709-4cf4-95e3-82de4b4d3d7a => generated 1723 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 16:36:08.090664 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-07052fd8-5f39-428f-8b8e-0054ca4624b5 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '499faf87cf8c41ae823b2566e4c2d8ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606ba814a2d8408ab0856d539ca79b4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:36:08.099485 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-07052fd8-5f39-428f-8b8e-0054ca4624b5 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] 10.222.0.18 "GET /compute/v2.1/servers/41c16116-97cf-4394-8c41-2d57d447d422" status: 200 len: 1368 microversion: 2.1 time: 0.538796 Jun 24 16:36:08.100325 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 224/422] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:36:07 2022] GET /compute/v2.1/servers/41c16116-97cf-4394-8c41-2d57d447d422 => generated 1368 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 16:36:09.045993 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-25ef2627-0c84-4b41-b889-a074d66f99ca tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Calling method '>' {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:36:09.047102 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-25ef2627-0c84-4b41-b889-a074d66f99ca tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] [instance: 1739cd84-3709-4cf4-95e3-82de4b4d3d7a] Fetching instance by UUID {{(pid=102149) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:36:09.060683 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-25ef2627-0c84-4b41-b889-a074d66f99ca tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:36:09.061496 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-25ef2627-0c84-4b41-b889-a074d66f99ca tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:36:09.062958 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-25ef2627-0c84-4b41-b889-a074d66f99ca tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:36:09.063741 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-25ef2627-0c84-4b41-b889-a074d66f99ca tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:36:09.121709 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-5d6fa981-c70b-4715-85ea-19e068a0ee24 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Calling method '>' {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:36:09.126894 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-5d6fa981-c70b-4715-85ea-19e068a0ee24 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] [instance: 41c16116-97cf-4394-8c41-2d57d447d422] Fetching instance by UUID {{(pid=102148) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:36:09.154447 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-5d6fa981-c70b-4715-85ea-19e068a0ee24 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:36:09.156286 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-5d6fa981-c70b-4715-85ea-19e068a0ee24 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:36:09.159876 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-5d6fa981-c70b-4715-85ea-19e068a0ee24 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:36:09.161212 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-5d6fa981-c70b-4715-85ea-19e068a0ee24 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:36:09.615034 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-25ef2627-0c84-4b41-b889-a074d66f99ca tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c286a3f03048689e5ec552bb89c161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09584de3a4b14c5a90eb9b1c2149d6fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:36:09.625514 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-5d6fa981-c70b-4715-85ea-19e068a0ee24 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '499faf87cf8c41ae823b2566e4c2d8ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606ba814a2d8408ab0856d539ca79b4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:36:09.633541 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-25ef2627-0c84-4b41-b889-a074d66f99ca tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] 10.222.0.18 "GET /compute/v2.1/servers/1739cd84-3709-4cf4-95e3-82de4b4d3d7a" status: 200 len: 1723 microversion: 2.1 time: 0.594131 Jun 24 16:36:09.634123 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 199/423] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:36:09 2022] GET /compute/v2.1/servers/1739cd84-3709-4cf4-95e3-82de4b4d3d7a => generated 1723 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 16:36:09.639354 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-5d6fa981-c70b-4715-85ea-19e068a0ee24 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] 10.222.0.18 "GET /compute/v2.1/servers/41c16116-97cf-4394-8c41-2d57d447d422" status: 200 len: 1368 microversion: 2.1 time: 0.526337 Jun 24 16:36:09.640453 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 225/424] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:36:09 2022] GET /compute/v2.1/servers/41c16116-97cf-4394-8c41-2d57d447d422 => generated 1368 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 16:36:10.660579 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-d5ffd64e-9930-4334-9b2e-3c6cee11f12b tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Calling method '>' {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:36:10.661720 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-d5ffd64e-9930-4334-9b2e-3c6cee11f12b tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] [instance: 41c16116-97cf-4394-8c41-2d57d447d422] Fetching instance by UUID {{(pid=102148) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:36:10.675412 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-d5ffd64e-9930-4334-9b2e-3c6cee11f12b tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:36:10.676879 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-d5ffd64e-9930-4334-9b2e-3c6cee11f12b tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:36:10.678310 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-d5ffd64e-9930-4334-9b2e-3c6cee11f12b tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:36:10.679596 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-d5ffd64e-9930-4334-9b2e-3c6cee11f12b tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:36:10.772953 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-f612ed52-fa3b-43e3-99fb-48009d43e92a tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] Action: 'create', calling method: .version_select at 0x7f1ae8429dc0>, body: {"keypair": {"name": "tempest-TestShelveInstance-2130265802", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEflV/I5eQG3/suSHNTs47gPO88Qw5gNNYINjPvgEHblR7/ahfKqzpRS6V6Akl11JYuomDKq98vuxWnAVmv8ZIRMbiB9yJBCxSdCTrHz/x+FXKbRPeqWuTr0DfMtWVHHLQ=="}} {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 16:36:10.854504 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.quota [None req-f612ed52-fa3b-43e3-99fb-48009d43e92a tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] Getting quotas for project a34b225f93234ca38c8d0c3d37ba0b8f. Resources: {'key_pairs'} {{(pid=102149) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jun 24 16:36:10.861148 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.quota [None req-f612ed52-fa3b-43e3-99fb-48009d43e92a tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] Getting quotas for user 0b823267a02a465192aadb5a1c5a3d92 and project a34b225f93234ca38c8d0c3d37ba0b8f. Resources: {'key_pairs'} {{(pid=102149) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jun 24 16:36:10.907877 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-f612ed52-fa3b-43e3-99fb-48009d43e92a tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.392963 Jun 24 16:36:10.908488 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 200/425] 10.222.0.18 () {60 vars in 1158 bytes} [Fri Jun 24 16:36:10 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 16:36:10.930046 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-35134220-2ae4-4b28-b90e-f8aa8885af03 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Calling method '>' {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:36:10.937372 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-35134220-2ae4-4b28-b90e-f8aa8885af03 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] [instance: 1739cd84-3709-4cf4-95e3-82de4b4d3d7a] Fetching instance by UUID {{(pid=102149) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:36:10.957605 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-35134220-2ae4-4b28-b90e-f8aa8885af03 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:36:10.958187 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-35134220-2ae4-4b28-b90e-f8aa8885af03 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:36:10.959521 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-35134220-2ae4-4b28-b90e-f8aa8885af03 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:36:10.959855 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-35134220-2ae4-4b28-b90e-f8aa8885af03 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:36:11.105439 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-d5ffd64e-9930-4334-9b2e-3c6cee11f12b tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '499faf87cf8c41ae823b2566e4c2d8ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606ba814a2d8408ab0856d539ca79b4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:36:11.116392 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-d5ffd64e-9930-4334-9b2e-3c6cee11f12b tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] 10.222.0.18 "GET /compute/v2.1/servers/41c16116-97cf-4394-8c41-2d57d447d422" status: 200 len: 1368 microversion: 2.1 time: 0.462309 Jun 24 16:36:11.118401 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 226/426] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:36:10 2022] GET /compute/v2.1/servers/41c16116-97cf-4394-8c41-2d57d447d422 => generated 1368 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 16:36:11.665553 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-35134220-2ae4-4b28-b90e-f8aa8885af03 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c286a3f03048689e5ec552bb89c161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09584de3a4b14c5a90eb9b1c2149d6fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:36:11.680588 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-35134220-2ae4-4b28-b90e-f8aa8885af03 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] 10.222.0.18 "GET /compute/v2.1/servers/1739cd84-3709-4cf4-95e3-82de4b4d3d7a" status: 200 len: 1723 microversion: 2.1 time: 0.768865 Jun 24 16:36:11.681213 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 201/427] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:36:10 2022] GET /compute/v2.1/servers/1739cd84-3709-4cf4-95e3-82de4b4d3d7a => generated 1723 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 16:36:12.135332 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-a0484ec8-16a2-4088-9a4c-ee7a3acc70df tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Calling method '>' {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:36:12.136882 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-a0484ec8-16a2-4088-9a4c-ee7a3acc70df tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] [instance: 41c16116-97cf-4394-8c41-2d57d447d422] Fetching instance by UUID {{(pid=102148) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:36:12.145806 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-a0484ec8-16a2-4088-9a4c-ee7a3acc70df tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:36:12.146332 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-a0484ec8-16a2-4088-9a4c-ee7a3acc70df tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:36:12.147738 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-a0484ec8-16a2-4088-9a4c-ee7a3acc70df tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:36:12.147738 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-a0484ec8-16a2-4088-9a4c-ee7a3acc70df tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:36:12.471197 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-a0484ec8-16a2-4088-9a4c-ee7a3acc70df tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '499faf87cf8c41ae823b2566e4c2d8ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606ba814a2d8408ab0856d539ca79b4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:36:12.487774 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-a0484ec8-16a2-4088-9a4c-ee7a3acc70df tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] 10.222.0.18 "GET /compute/v2.1/servers/41c16116-97cf-4394-8c41-2d57d447d422" status: 200 len: 1368 microversion: 2.1 time: 0.355936 Jun 24 16:36:12.488804 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 227/428] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:36:12 2022] GET /compute/v2.1/servers/41c16116-97cf-4394-8c41-2d57d447d422 => generated 1368 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 16:36:12.713177 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-1df3a73b-f57f-4064-9f64-3b7b4dd764e0 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Calling method '>' {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:36:12.714810 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-1df3a73b-f57f-4064-9f64-3b7b4dd764e0 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] [instance: 1739cd84-3709-4cf4-95e3-82de4b4d3d7a] Fetching instance by UUID {{(pid=102149) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:36:12.724421 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-1df3a73b-f57f-4064-9f64-3b7b4dd764e0 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:36:12.725141 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-1df3a73b-f57f-4064-9f64-3b7b4dd764e0 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:36:12.726211 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-1df3a73b-f57f-4064-9f64-3b7b4dd764e0 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:36:12.726968 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-1df3a73b-f57f-4064-9f64-3b7b4dd764e0 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:36:13.144697 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-1df3a73b-f57f-4064-9f64-3b7b4dd764e0 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c286a3f03048689e5ec552bb89c161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09584de3a4b14c5a90eb9b1c2149d6fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:36:13.153805 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-1df3a73b-f57f-4064-9f64-3b7b4dd764e0 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] 10.222.0.18 "GET /compute/v2.1/servers/1739cd84-3709-4cf4-95e3-82de4b4d3d7a" status: 200 len: 1729 microversion: 2.1 time: 0.450649 Jun 24 16:36:13.171715 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-11c74bb0-a2db-4f07-bc89-0978fe6ee3dd tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Calling method '>' {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:36:13.172208 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-11c74bb0-a2db-4f07-bc89-0978fe6ee3dd tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] [instance: 1739cd84-3709-4cf4-95e3-82de4b4d3d7a] Fetching instance by UUID {{(pid=102148) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:36:13.177157 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 202/429] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:36:12 2022] GET /compute/v2.1/servers/1739cd84-3709-4cf4-95e3-82de4b4d3d7a => generated 1729 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 16:36:13.181277 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-11c74bb0-a2db-4f07-bc89-0978fe6ee3dd tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:36:13.181799 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-11c74bb0-a2db-4f07-bc89-0978fe6ee3dd tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:36:13.182855 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-11c74bb0-a2db-4f07-bc89-0978fe6ee3dd tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:36:13.183488 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-11c74bb0-a2db-4f07-bc89-0978fe6ee3dd tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:36:13.512605 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-f16aef97-2451-44fa-a7c7-49ba586f30b8 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Calling method '>' {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:36:13.513757 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-f16aef97-2451-44fa-a7c7-49ba586f30b8 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] [instance: 41c16116-97cf-4394-8c41-2d57d447d422] Fetching instance by UUID {{(pid=102149) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:36:13.537081 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-f16aef97-2451-44fa-a7c7-49ba586f30b8 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:36:13.537872 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-f16aef97-2451-44fa-a7c7-49ba586f30b8 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:36:13.543582 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-f16aef97-2451-44fa-a7c7-49ba586f30b8 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:36:13.545780 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-f16aef97-2451-44fa-a7c7-49ba586f30b8 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:36:13.552587 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-11c74bb0-a2db-4f07-bc89-0978fe6ee3dd tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] 10.222.0.18 "GET /compute/v2.1/servers/1739cd84-3709-4cf4-95e3-82de4b4d3d7a/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.384836 Jun 24 16:36:13.563676 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 228/430] 10.222.0.18 () {58 vars in 1274 bytes} [Fri Jun 24 16:36:13 2022] GET /compute/v2.1/servers/1739cd84-3709-4cf4-95e3-82de4b4d3d7a/os-interface => generated 285 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 16:36:13.919742 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-f16aef97-2451-44fa-a7c7-49ba586f30b8 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '499faf87cf8c41ae823b2566e4c2d8ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606ba814a2d8408ab0856d539ca79b4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:36:13.934403 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-f16aef97-2451-44fa-a7c7-49ba586f30b8 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] 10.222.0.18 "GET /compute/v2.1/servers/41c16116-97cf-4394-8c41-2d57d447d422" status: 200 len: 1368 microversion: 2.1 time: 0.429705 Jun 24 16:36:13.934911 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-c128444a-a01b-4737-bb2e-5827dd6ba90d tempest-VolumesSnapshotTestJSON-1294974655 tempest-VolumesSnapshotTestJSON-1294974655-project] Calling method '>' {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:36:13.936389 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 203/431] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:36:13 2022] GET /compute/v2.1/servers/41c16116-97cf-4394-8c41-2d57d447d422 => generated 1368 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 16:36:13.944682 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-c128444a-a01b-4737-bb2e-5827dd6ba90d tempest-VolumesSnapshotTestJSON-1294974655 tempest-VolumesSnapshotTestJSON-1294974655-project] [instance: ebd2b19d-ddad-422b-a276-0fb7cbe80753] Fetching instance by UUID {{(pid=102148) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:36:13.964755 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-c128444a-a01b-4737-bb2e-5827dd6ba90d tempest-VolumesSnapshotTestJSON-1294974655 tempest-VolumesSnapshotTestJSON-1294974655-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:36:13.968351 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-c128444a-a01b-4737-bb2e-5827dd6ba90d tempest-VolumesSnapshotTestJSON-1294974655 tempest-VolumesSnapshotTestJSON-1294974655-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:36:13.969252 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-c128444a-a01b-4737-bb2e-5827dd6ba90d tempest-VolumesSnapshotTestJSON-1294974655 tempest-VolumesSnapshotTestJSON-1294974655-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:36:13.969798 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-c128444a-a01b-4737-bb2e-5827dd6ba90d tempest-VolumesSnapshotTestJSON-1294974655 tempest-VolumesSnapshotTestJSON-1294974655-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:36:14.496513 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.objects.instance [None req-c128444a-a01b-4737-bb2e-5827dd6ba90d tempest-VolumesSnapshotTestJSON-1294974655 tempest-VolumesSnapshotTestJSON-1294974655-project] Lazy-loading 'services' on Instance uuid ebd2b19d-ddad-422b-a276-0fb7cbe80753 {{(pid=102148) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Jun 24 16:36:14.721972 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-c128444a-a01b-4737-bb2e-5827dd6ba90d tempest-VolumesSnapshotTestJSON-1294974655 tempest-VolumesSnapshotTestJSON-1294974655-project] 10.222.0.18 "DELETE /compute/v2.1/servers/ebd2b19d-ddad-422b-a276-0fb7cbe80753/os-volume_attachments/8a7aaeb6-8c99-4658-8776-844681db380e" status: 202 len: 0 microversion: 2.1 time: 0.791651 Jun 24 16:36:14.723848 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 229/432] 10.222.0.18 () {58 vars in 1415 bytes} [Fri Jun 24 16:36:13 2022] DELETE /compute/v2.1/servers/ebd2b19d-ddad-422b-a276-0fb7cbe80753/os-volume_attachments/8a7aaeb6-8c99-4658-8776-844681db380e => generated 0 bytes in 795 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 24 16:36:14.959864 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-41f85782-edb3-4ba9-84a0-43ef25324251 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Calling method '>' {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:36:14.961244 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-41f85782-edb3-4ba9-84a0-43ef25324251 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] [instance: 41c16116-97cf-4394-8c41-2d57d447d422] Fetching instance by UUID {{(pid=102149) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:36:14.972022 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-41f85782-edb3-4ba9-84a0-43ef25324251 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:36:14.972851 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-41f85782-edb3-4ba9-84a0-43ef25324251 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:36:14.974171 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-41f85782-edb3-4ba9-84a0-43ef25324251 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:36:14.974850 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-41f85782-edb3-4ba9-84a0-43ef25324251 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:36:15.275155 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-41f85782-edb3-4ba9-84a0-43ef25324251 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '499faf87cf8c41ae823b2566e4c2d8ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606ba814a2d8408ab0856d539ca79b4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:36:15.308451 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-41f85782-edb3-4ba9-84a0-43ef25324251 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] 10.222.0.18 "GET /compute/v2.1/servers/41c16116-97cf-4394-8c41-2d57d447d422" status: 200 len: 1368 microversion: 2.1 time: 0.355689 Jun 24 16:36:15.324497 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 204/433] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:36:14 2022] GET /compute/v2.1/servers/41c16116-97cf-4394-8c41-2d57d447d422 => generated 1368 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 16:36:16.122543 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-286d0391-8341-421e-89f3-aeacbb572c2e tempest-VolumesSnapshotTestJSON-1294974655 tempest-VolumesSnapshotTestJSON-1294974655-project] Calling method '>' {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:36:16.123778 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-286d0391-8341-421e-89f3-aeacbb572c2e tempest-VolumesSnapshotTestJSON-1294974655 tempest-VolumesSnapshotTestJSON-1294974655-project] [instance: ebd2b19d-ddad-422b-a276-0fb7cbe80753] Fetching instance by UUID {{(pid=102148) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:36:16.140144 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-286d0391-8341-421e-89f3-aeacbb572c2e tempest-VolumesSnapshotTestJSON-1294974655 tempest-VolumesSnapshotTestJSON-1294974655-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:36:16.140988 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-286d0391-8341-421e-89f3-aeacbb572c2e tempest-VolumesSnapshotTestJSON-1294974655 tempest-VolumesSnapshotTestJSON-1294974655-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:36:16.148796 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-286d0391-8341-421e-89f3-aeacbb572c2e tempest-VolumesSnapshotTestJSON-1294974655 tempest-VolumesSnapshotTestJSON-1294974655-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:36:16.151066 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-286d0391-8341-421e-89f3-aeacbb572c2e tempest-VolumesSnapshotTestJSON-1294974655 tempest-VolumesSnapshotTestJSON-1294974655-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:36:16.240401 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [req-45b15196-cb79-473e-a2a5-9bc39af0ce0f req-123f4ab2-237f-452f-aaef-e3e625929454 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1739cd84-3709-4cf4-95e3-82de4b4d3d7a", "tag": "8a215961-1299-415e-b991-1271a78f7ae0"}]} {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 16:36:16.243285 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 24 16:36:16.243285 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: warnings.warn(msg) Jun 24 16:36:16.256533 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [req-45b15196-cb79-473e-a2a5-9bc39af0ce0f req-123f4ab2-237f-452f-aaef-e3e625929454 service nova] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:36:16.257861 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [req-45b15196-cb79-473e-a2a5-9bc39af0ce0f req-123f4ab2-237f-452f-aaef-e3e625929454 service nova] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:36:16.279389 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.compute.server_external_events [req-45b15196-cb79-473e-a2a5-9bc39af0ce0f req-123f4ab2-237f-452f-aaef-e3e625929454 service nova] Creating event network-changed:8a215961-1299-415e-b991-1271a78f7ae0 for instance 1739cd84-3709-4cf4-95e3-82de4b4d3d7a on hv-cinder-84718 Jun 24 16:36:16.288303 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [req-45b15196-cb79-473e-a2a5-9bc39af0ce0f req-123f4ab2-237f-452f-aaef-e3e625929454 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052139 Jun 24 16:36:16.291865 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 205/434] 10.222.0.18 () {64 vars in 1317 bytes} [Fri Jun 24 16:36:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 16:36:16.295875 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-286d0391-8341-421e-89f3-aeacbb572c2e tempest-VolumesSnapshotTestJSON-1294974655 tempest-VolumesSnapshotTestJSON-1294974655-project] [instance: ebd2b19d-ddad-422b-a276-0fb7cbe80753] Going to try to terminate instance {{(pid=102148) delete /opt/stack/nova/nova/compute/api.py:2562}} Jun 24 16:36:16.358305 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-6e0068e2-8b0b-4d38-9fa6-05773825fcc0 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Calling method '>' {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:36:16.359676 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-6e0068e2-8b0b-4d38-9fa6-05773825fcc0 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] [instance: 41c16116-97cf-4394-8c41-2d57d447d422] Fetching instance by UUID {{(pid=102149) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:36:16.389171 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-6e0068e2-8b0b-4d38-9fa6-05773825fcc0 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:36:16.392789 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-6e0068e2-8b0b-4d38-9fa6-05773825fcc0 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:36:16.396416 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-6e0068e2-8b0b-4d38-9fa6-05773825fcc0 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:36:16.397590 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-6e0068e2-8b0b-4d38-9fa6-05773825fcc0 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:36:16.567589 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-286d0391-8341-421e-89f3-aeacbb572c2e tempest-VolumesSnapshotTestJSON-1294974655 tempest-VolumesSnapshotTestJSON-1294974655-project] 10.222.0.18 "DELETE /compute/v2.1/servers/ebd2b19d-ddad-422b-a276-0fb7cbe80753" status: 204 len: 0 microversion: 2.1 time: 0.449927 Jun 24 16:36:16.568909 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 230/435] 10.222.0.18 () {58 vars in 1238 bytes} [Fri Jun 24 16:36:16 2022] DELETE /compute/v2.1/servers/ebd2b19d-ddad-422b-a276-0fb7cbe80753 => generated 0 bytes in 453 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 24 16:36:16.581226 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-a313adcc-04cf-417d-80ba-5198cb47e706 tempest-VolumesSnapshotTestJSON-1294974655 tempest-VolumesSnapshotTestJSON-1294974655-project] Calling method '>' {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:36:16.582119 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-a313adcc-04cf-417d-80ba-5198cb47e706 tempest-VolumesSnapshotTestJSON-1294974655 tempest-VolumesSnapshotTestJSON-1294974655-project] [instance: ebd2b19d-ddad-422b-a276-0fb7cbe80753] Fetching instance by UUID {{(pid=102148) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:36:16.606915 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-a313adcc-04cf-417d-80ba-5198cb47e706 tempest-VolumesSnapshotTestJSON-1294974655 tempest-VolumesSnapshotTestJSON-1294974655-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:36:16.607531 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-a313adcc-04cf-417d-80ba-5198cb47e706 tempest-VolumesSnapshotTestJSON-1294974655 tempest-VolumesSnapshotTestJSON-1294974655-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:36:16.608575 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-a313adcc-04cf-417d-80ba-5198cb47e706 tempest-VolumesSnapshotTestJSON-1294974655 tempest-VolumesSnapshotTestJSON-1294974655-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:36:16.609077 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-a313adcc-04cf-417d-80ba-5198cb47e706 tempest-VolumesSnapshotTestJSON-1294974655 tempest-VolumesSnapshotTestJSON-1294974655-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:36:16.857803 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-6e0068e2-8b0b-4d38-9fa6-05773825fcc0 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '499faf87cf8c41ae823b2566e4c2d8ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606ba814a2d8408ab0856d539ca79b4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:36:16.868420 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-6e0068e2-8b0b-4d38-9fa6-05773825fcc0 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] 10.222.0.18 "GET /compute/v2.1/servers/41c16116-97cf-4394-8c41-2d57d447d422" status: 200 len: 1368 microversion: 2.1 time: 0.519873 Jun 24 16:36:16.869213 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 206/436] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:36:16 2022] GET /compute/v2.1/servers/41c16116-97cf-4394-8c41-2d57d447d422 => generated 1368 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 16:36:16.974001 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-a313adcc-04cf-417d-80ba-5198cb47e706 tempest-VolumesSnapshotTestJSON-1294974655 tempest-VolumesSnapshotTestJSON-1294974655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7b98bac241449c9a8b14307e4f7993a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0966981b5f4c3fa17c73c0c4b31779', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:36:16.987225 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-a313adcc-04cf-417d-80ba-5198cb47e706 tempest-VolumesSnapshotTestJSON-1294974655 tempest-VolumesSnapshotTestJSON-1294974655-project] 10.222.0.18 "GET /compute/v2.1/servers/ebd2b19d-ddad-422b-a276-0fb7cbe80753" status: 200 len: 1514 microversion: 2.1 time: 0.411464 Jun 24 16:36:16.998057 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 231/437] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:36:16 2022] GET /compute/v2.1/servers/ebd2b19d-ddad-422b-a276-0fb7cbe80753 => generated 1514 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 16:36:17.223965 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [req-333908ba-d18b-4039-952b-73e57975b610 req-fc7ab40e-697b-46ee-b008-8a5c40939a01 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "41c16116-97cf-4394-8c41-2d57d447d422", "name": "network-vif-plugged", "status": "completed", "tag": "6ccb72c8-72c5-4467-a284-d1c79d49c232"}]} {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 16:36:17.226880 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 24 16:36:17.226880 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: warnings.warn(msg) Jun 24 16:36:17.236623 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [req-333908ba-d18b-4039-952b-73e57975b610 req-fc7ab40e-697b-46ee-b008-8a5c40939a01 service nova] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:36:17.237421 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [req-333908ba-d18b-4039-952b-73e57975b610 req-fc7ab40e-697b-46ee-b008-8a5c40939a01 service nova] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:36:17.260300 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.compute.server_external_events [req-333908ba-d18b-4039-952b-73e57975b610 req-fc7ab40e-697b-46ee-b008-8a5c40939a01 service nova] Creating event network-vif-plugged:6ccb72c8-72c5-4467-a284-d1c79d49c232 for instance 41c16116-97cf-4394-8c41-2d57d447d422 on hv-cinder-84718 Jun 24 16:36:17.268291 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [req-333908ba-d18b-4039-952b-73e57975b610 req-fc7ab40e-697b-46ee-b008-8a5c40939a01 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048674 Jun 24 16:36:17.272779 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 207/438] 10.222.0.18 () {64 vars in 1317 bytes} [Fri Jun 24 16:36:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 16:36:17.891295 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-d85c5418-8071-4b19-b695-23b460856adf tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Calling method '>' {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:36:17.892401 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-d85c5418-8071-4b19-b695-23b460856adf tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] [instance: 41c16116-97cf-4394-8c41-2d57d447d422] Fetching instance by UUID {{(pid=102148) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:36:17.905951 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-d85c5418-8071-4b19-b695-23b460856adf tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:36:17.906556 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-d85c5418-8071-4b19-b695-23b460856adf tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:36:17.907964 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-d85c5418-8071-4b19-b695-23b460856adf tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:36:17.908829 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-d85c5418-8071-4b19-b695-23b460856adf tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:36:18.005884 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-f8a06d59-0da7-4cfb-9fd7-d2d82f70a175 tempest-VolumesSnapshotTestJSON-1294974655 tempest-VolumesSnapshotTestJSON-1294974655-project] Calling method '>' {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:36:18.006592 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-f8a06d59-0da7-4cfb-9fd7-d2d82f70a175 tempest-VolumesSnapshotTestJSON-1294974655 tempest-VolumesSnapshotTestJSON-1294974655-project] [instance: ebd2b19d-ddad-422b-a276-0fb7cbe80753] Fetching instance by UUID {{(pid=102149) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:36:18.029978 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-f8a06d59-0da7-4cfb-9fd7-d2d82f70a175 tempest-VolumesSnapshotTestJSON-1294974655 tempest-VolumesSnapshotTestJSON-1294974655-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:36:18.031403 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-f8a06d59-0da7-4cfb-9fd7-d2d82f70a175 tempest-VolumesSnapshotTestJSON-1294974655 tempest-VolumesSnapshotTestJSON-1294974655-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:36:18.032778 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-f8a06d59-0da7-4cfb-9fd7-d2d82f70a175 tempest-VolumesSnapshotTestJSON-1294974655 tempest-VolumesSnapshotTestJSON-1294974655-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:36:18.033980 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-f8a06d59-0da7-4cfb-9fd7-d2d82f70a175 tempest-VolumesSnapshotTestJSON-1294974655 tempest-VolumesSnapshotTestJSON-1294974655-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:36:18.193166 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-d85c5418-8071-4b19-b695-23b460856adf tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '499faf87cf8c41ae823b2566e4c2d8ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606ba814a2d8408ab0856d539ca79b4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:36:18.209497 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-d85c5418-8071-4b19-b695-23b460856adf tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] 10.222.0.18 "GET /compute/v2.1/servers/41c16116-97cf-4394-8c41-2d57d447d422" status: 200 len: 1368 microversion: 2.1 time: 0.325217 Jun 24 16:36:18.210590 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 232/439] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:36:17 2022] GET /compute/v2.1/servers/41c16116-97cf-4394-8c41-2d57d447d422 => generated 1368 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 16:36:18.306414 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [req-05c36f7a-2f80-4100-a0dc-d9ad5c631d2e req-729ce230-a6e5-4634-a678-0a4f6f338961 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1739cd84-3709-4cf4-95e3-82de4b4d3d7a", "tag": "8a215961-1299-415e-b991-1271a78f7ae0"}]} {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 16:36:18.311639 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 24 16:36:18.311639 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: warnings.warn(msg) Jun 24 16:36:18.329382 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [req-05c36f7a-2f80-4100-a0dc-d9ad5c631d2e req-729ce230-a6e5-4634-a678-0a4f6f338961 service nova] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:36:18.330195 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [req-05c36f7a-2f80-4100-a0dc-d9ad5c631d2e req-729ce230-a6e5-4634-a678-0a4f6f338961 service nova] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:36:18.362575 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.compute.server_external_events [req-05c36f7a-2f80-4100-a0dc-d9ad5c631d2e req-729ce230-a6e5-4634-a678-0a4f6f338961 service nova] Creating event network-changed:8a215961-1299-415e-b991-1271a78f7ae0 for instance 1739cd84-3709-4cf4-95e3-82de4b4d3d7a on hv-cinder-84718 Jun 24 16:36:18.371325 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [req-05c36f7a-2f80-4100-a0dc-d9ad5c631d2e req-729ce230-a6e5-4634-a678-0a4f6f338961 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070093 Jun 24 16:36:18.372753 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 233/440] 10.222.0.18 () {64 vars in 1317 bytes} [Fri Jun 24 16:36:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 16:36:18.436358 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-f8a06d59-0da7-4cfb-9fd7-d2d82f70a175 tempest-VolumesSnapshotTestJSON-1294974655 tempest-VolumesSnapshotTestJSON-1294974655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7b98bac241449c9a8b14307e4f7993a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0966981b5f4c3fa17c73c0c4b31779', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:36:18.455939 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-f8a06d59-0da7-4cfb-9fd7-d2d82f70a175 tempest-VolumesSnapshotTestJSON-1294974655 tempest-VolumesSnapshotTestJSON-1294974655-project] 10.222.0.18 "GET /compute/v2.1/servers/ebd2b19d-ddad-422b-a276-0fb7cbe80753" status: 200 len: 1514 microversion: 2.1 time: 0.453866 Jun 24 16:36:18.456955 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 208/441] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:36:18 2022] GET /compute/v2.1/servers/ebd2b19d-ddad-422b-a276-0fb7cbe80753 => generated 1514 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 16:36:19.239870 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-8a0c8b17-f90e-43ac-a53c-828b97e15f2a tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Calling method '>' {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:36:19.242047 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-8a0c8b17-f90e-43ac-a53c-828b97e15f2a tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] [instance: 41c16116-97cf-4394-8c41-2d57d447d422] Fetching instance by UUID {{(pid=102148) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:36:19.258177 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-8a0c8b17-f90e-43ac-a53c-828b97e15f2a tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:36:19.258900 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-8a0c8b17-f90e-43ac-a53c-828b97e15f2a tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:36:19.259928 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-8a0c8b17-f90e-43ac-a53c-828b97e15f2a tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:36:19.260430 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-8a0c8b17-f90e-43ac-a53c-828b97e15f2a tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:36:19.485111 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-7287f193-27ab-4928-8513-27c521611f43 tempest-VolumesSnapshotTestJSON-1294974655 tempest-VolumesSnapshotTestJSON-1294974655-project] Calling method '>' {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:36:19.489381 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-7287f193-27ab-4928-8513-27c521611f43 tempest-VolumesSnapshotTestJSON-1294974655 tempest-VolumesSnapshotTestJSON-1294974655-project] [instance: ebd2b19d-ddad-422b-a276-0fb7cbe80753] Fetching instance by UUID {{(pid=102149) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:36:19.499193 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-7287f193-27ab-4928-8513-27c521611f43 tempest-VolumesSnapshotTestJSON-1294974655 tempest-VolumesSnapshotTestJSON-1294974655-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:36:19.500471 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-7287f193-27ab-4928-8513-27c521611f43 tempest-VolumesSnapshotTestJSON-1294974655 tempest-VolumesSnapshotTestJSON-1294974655-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:36:19.502129 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-7287f193-27ab-4928-8513-27c521611f43 tempest-VolumesSnapshotTestJSON-1294974655 tempest-VolumesSnapshotTestJSON-1294974655-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:36:19.502973 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-7287f193-27ab-4928-8513-27c521611f43 tempest-VolumesSnapshotTestJSON-1294974655 tempest-VolumesSnapshotTestJSON-1294974655-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:36:19.821727 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-8a0c8b17-f90e-43ac-a53c-828b97e15f2a tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '499faf87cf8c41ae823b2566e4c2d8ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606ba814a2d8408ab0856d539ca79b4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:36:19.832652 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-8a0c8b17-f90e-43ac-a53c-828b97e15f2a tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] 10.222.0.18 "GET /compute/v2.1/servers/41c16116-97cf-4394-8c41-2d57d447d422" status: 200 len: 1368 microversion: 2.1 time: 0.603240 Jun 24 16:36:19.840324 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 234/442] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:36:19 2022] GET /compute/v2.1/servers/41c16116-97cf-4394-8c41-2d57d447d422 => generated 1368 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 16:36:20.082899 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-7287f193-27ab-4928-8513-27c521611f43 tempest-VolumesSnapshotTestJSON-1294974655 tempest-VolumesSnapshotTestJSON-1294974655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7b98bac241449c9a8b14307e4f7993a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0966981b5f4c3fa17c73c0c4b31779', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:36:20.094309 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-7287f193-27ab-4928-8513-27c521611f43 tempest-VolumesSnapshotTestJSON-1294974655 tempest-VolumesSnapshotTestJSON-1294974655-project] 10.222.0.18 "GET /compute/v2.1/servers/ebd2b19d-ddad-422b-a276-0fb7cbe80753" status: 200 len: 1514 microversion: 2.1 time: 0.616101 Jun 24 16:36:20.095289 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 209/443] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:36:19 2022] GET /compute/v2.1/servers/ebd2b19d-ddad-422b-a276-0fb7cbe80753 => generated 1514 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 16:36:20.705661 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [req-74d60600-e83d-40a9-b100-79b5dc1aa4d9 req-8f17b379-bbda-4fd2-91d1-b71e1625b75d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ebd2b19d-ddad-422b-a276-0fb7cbe80753", "name": "network-vif-deleted", "tag": "79e89c64-b194-4135-979d-680ac5e90936"}]} {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 16:36:20.708597 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 24 16:36:20.708597 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: warnings.warn(msg) Jun 24 16:36:20.722576 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [req-74d60600-e83d-40a9-b100-79b5dc1aa4d9 req-8f17b379-bbda-4fd2-91d1-b71e1625b75d service nova] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:36:20.723393 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [req-74d60600-e83d-40a9-b100-79b5dc1aa4d9 req-8f17b379-bbda-4fd2-91d1-b71e1625b75d service nova] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:36:20.743534 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.compute.server_external_events [req-74d60600-e83d-40a9-b100-79b5dc1aa4d9 req-8f17b379-bbda-4fd2-91d1-b71e1625b75d service nova] Creating event network-vif-deleted:79e89c64-b194-4135-979d-680ac5e90936 for instance ebd2b19d-ddad-422b-a276-0fb7cbe80753 on hv-cinder-84718 Jun 24 16:36:20.748790 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [req-74d60600-e83d-40a9-b100-79b5dc1aa4d9 req-8f17b379-bbda-4fd2-91d1-b71e1625b75d service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048992 Jun 24 16:36:20.749762 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 235/444] 10.222.0.18 () {64 vars in 1317 bytes} [Fri Jun 24 16:36:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 16:36:20.857648 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-37d2c8eb-ca75-41c7-a635-421924f8116d tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Calling method '>' {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:36:20.861102 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-37d2c8eb-ca75-41c7-a635-421924f8116d tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] [instance: 41c16116-97cf-4394-8c41-2d57d447d422] Fetching instance by UUID {{(pid=102149) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:36:20.875986 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-37d2c8eb-ca75-41c7-a635-421924f8116d tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:36:20.877032 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-37d2c8eb-ca75-41c7-a635-421924f8116d tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:36:20.878743 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-37d2c8eb-ca75-41c7-a635-421924f8116d tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:36:20.879750 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-37d2c8eb-ca75-41c7-a635-421924f8116d tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:36:21.120160 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-3e7a73a0-9a93-44ca-82b8-4607f4e8d7e2 tempest-VolumesSnapshotTestJSON-1294974655 tempest-VolumesSnapshotTestJSON-1294974655-project] Calling method '>' {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:36:21.120859 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-3e7a73a0-9a93-44ca-82b8-4607f4e8d7e2 tempest-VolumesSnapshotTestJSON-1294974655 tempest-VolumesSnapshotTestJSON-1294974655-project] [instance: ebd2b19d-ddad-422b-a276-0fb7cbe80753] Fetching instance by UUID {{(pid=102148) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:36:21.132651 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-3e7a73a0-9a93-44ca-82b8-4607f4e8d7e2 tempest-VolumesSnapshotTestJSON-1294974655 tempest-VolumesSnapshotTestJSON-1294974655-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:36:21.133470 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-3e7a73a0-9a93-44ca-82b8-4607f4e8d7e2 tempest-VolumesSnapshotTestJSON-1294974655 tempest-VolumesSnapshotTestJSON-1294974655-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:36:21.134563 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-3e7a73a0-9a93-44ca-82b8-4607f4e8d7e2 tempest-VolumesSnapshotTestJSON-1294974655 tempest-VolumesSnapshotTestJSON-1294974655-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:36:21.135018 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-3e7a73a0-9a93-44ca-82b8-4607f4e8d7e2 tempest-VolumesSnapshotTestJSON-1294974655 tempest-VolumesSnapshotTestJSON-1294974655-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:36:21.154051 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-37d2c8eb-ca75-41c7-a635-421924f8116d tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '499faf87cf8c41ae823b2566e4c2d8ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606ba814a2d8408ab0856d539ca79b4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:36:21.168743 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-37d2c8eb-ca75-41c7-a635-421924f8116d tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] 10.222.0.18 "GET /compute/v2.1/servers/41c16116-97cf-4394-8c41-2d57d447d422" status: 200 len: 1558 microversion: 2.1 time: 0.318099 Jun 24 16:36:21.169316 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 210/445] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:36:20 2022] GET /compute/v2.1/servers/41c16116-97cf-4394-8c41-2d57d447d422 => generated 1558 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 16:36:21.207507 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-70e16f72-6305-4716-93b2-375d24dd57cc tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Calling method '>' {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:36:21.207884 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-70e16f72-6305-4716-93b2-375d24dd57cc tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] [instance: 41c16116-97cf-4394-8c41-2d57d447d422] Fetching instance by UUID {{(pid=102149) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:36:21.217655 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-3e7a73a0-9a93-44ca-82b8-4607f4e8d7e2 tempest-VolumesSnapshotTestJSON-1294974655 tempest-VolumesSnapshotTestJSON-1294974655-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:36:21.218098 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-3e7a73a0-9a93-44ca-82b8-4607f4e8d7e2 tempest-VolumesSnapshotTestJSON-1294974655 tempest-VolumesSnapshotTestJSON-1294974655-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:36:21.218259 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-70e16f72-6305-4716-93b2-375d24dd57cc tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:36:21.218575 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.objects.instance [None req-3e7a73a0-9a93-44ca-82b8-4607f4e8d7e2 tempest-VolumesSnapshotTestJSON-1294974655 tempest-VolumesSnapshotTestJSON-1294974655-project] Lazy-loading 'fault' on Instance uuid ebd2b19d-ddad-422b-a276-0fb7cbe80753 {{(pid=102148) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Jun 24 16:36:21.218786 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-70e16f72-6305-4716-93b2-375d24dd57cc tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:36:21.219639 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-70e16f72-6305-4716-93b2-375d24dd57cc tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:36:21.220036 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-70e16f72-6305-4716-93b2-375d24dd57cc tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:36:21.400520 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-3e7a73a0-9a93-44ca-82b8-4607f4e8d7e2 tempest-VolumesSnapshotTestJSON-1294974655 tempest-VolumesSnapshotTestJSON-1294974655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7b98bac241449c9a8b14307e4f7993a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0966981b5f4c3fa17c73c0c4b31779', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:36:21.415372 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-3e7a73a0-9a93-44ca-82b8-4607f4e8d7e2 tempest-VolumesSnapshotTestJSON-1294974655 tempest-VolumesSnapshotTestJSON-1294974655-project] 10.222.0.18 "GET /compute/v2.1/servers/ebd2b19d-ddad-422b-a276-0fb7cbe80753" status: 200 len: 1309 microversion: 2.1 time: 0.298905 Jun 24 16:36:21.429568 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 236/446] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:36:21 2022] GET /compute/v2.1/servers/ebd2b19d-ddad-422b-a276-0fb7cbe80753 => generated 1309 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 16:36:21.473765 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-70e16f72-6305-4716-93b2-375d24dd57cc tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] 10.222.0.18 "GET /compute/v2.1/servers/41c16116-97cf-4394-8c41-2d57d447d422/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.282677 Jun 24 16:36:21.474361 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 211/447] 10.222.0.18 () {58 vars in 1274 bytes} [Fri Jun 24 16:36:21 2022] GET /compute/v2.1/servers/41c16116-97cf-4394-8c41-2d57d447d422/os-interface => generated 284 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 16:36:21.767478 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-4f3f6fb7-cd12-4442-9440-62ce36deed6f tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Calling method '>' {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:36:21.768349 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-4f3f6fb7-cd12-4442-9440-62ce36deed6f tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] [instance: 30b3ffec-7110-4b4d-9482-2451914c166f] Fetching instance by UUID {{(pid=102148) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:36:21.782560 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-4f3f6fb7-cd12-4442-9440-62ce36deed6f tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:36:21.783466 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-4f3f6fb7-cd12-4442-9440-62ce36deed6f tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:36:21.784854 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-4f3f6fb7-cd12-4442-9440-62ce36deed6f tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:36:21.785640 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-4f3f6fb7-cd12-4442-9440-62ce36deed6f tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:36:21.859823 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-4f3f6fb7-cd12-4442-9440-62ce36deed6f tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] 10.222.0.18 "GET /compute/v2.1/servers/30b3ffec-7110-4b4d-9482-2451914c166f/os-volume_attachments/1598106d-a439-42b7-b406-ce5a40120d83" status: 200 len: 194 microversion: 2.20 time: 0.098098 Jun 24 16:36:21.860422 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 237/448] 10.222.0.18 () {60 vars in 1453 bytes} [Fri Jun 24 16:36:21 2022] GET /compute/v2.1/servers/30b3ffec-7110-4b4d-9482-2451914c166f/os-volume_attachments/1598106d-a439-42b7-b406-ce5a40120d83 => generated 194 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 16:36:21.982426 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-c1cb7421-c31a-400f-97cc-b00e8bd27398 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Calling method '>' {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:36:21.983250 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-c1cb7421-c31a-400f-97cc-b00e8bd27398 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] [instance: 30b3ffec-7110-4b4d-9482-2451914c166f] Fetching instance by UUID {{(pid=102149) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:36:21.991159 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-c1cb7421-c31a-400f-97cc-b00e8bd27398 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:36:21.992228 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-c1cb7421-c31a-400f-97cc-b00e8bd27398 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:36:21.993030 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-c1cb7421-c31a-400f-97cc-b00e8bd27398 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:36:21.993456 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-c1cb7421-c31a-400f-97cc-b00e8bd27398 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:36:22.283524 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.objects.instance [None req-c1cb7421-c31a-400f-97cc-b00e8bd27398 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lazy-loading 'services' on Instance uuid 30b3ffec-7110-4b4d-9482-2451914c166f {{(pid=102149) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Jun 24 16:36:22.443812 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-348f23c0-1d99-494f-9e4b-bd6548a0cd8b tempest-VolumesSnapshotTestJSON-1294974655 tempest-VolumesSnapshotTestJSON-1294974655-project] Calling method '>' {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:36:22.445241 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-348f23c0-1d99-494f-9e4b-bd6548a0cd8b tempest-VolumesSnapshotTestJSON-1294974655 tempest-VolumesSnapshotTestJSON-1294974655-project] [instance: ebd2b19d-ddad-422b-a276-0fb7cbe80753] Fetching instance by UUID {{(pid=102148) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:36:22.461482 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-348f23c0-1d99-494f-9e4b-bd6548a0cd8b tempest-VolumesSnapshotTestJSON-1294974655 tempest-VolumesSnapshotTestJSON-1294974655-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:36:22.461942 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-348f23c0-1d99-494f-9e4b-bd6548a0cd8b tempest-VolumesSnapshotTestJSON-1294974655 tempest-VolumesSnapshotTestJSON-1294974655-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:36:22.462990 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-348f23c0-1d99-494f-9e4b-bd6548a0cd8b tempest-VolumesSnapshotTestJSON-1294974655 tempest-VolumesSnapshotTestJSON-1294974655-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:36:22.463427 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-348f23c0-1d99-494f-9e4b-bd6548a0cd8b tempest-VolumesSnapshotTestJSON-1294974655 tempest-VolumesSnapshotTestJSON-1294974655-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:36:22.477414 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-c1cb7421-c31a-400f-97cc-b00e8bd27398 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] 10.222.0.18 "DELETE /compute/v2.1/servers/30b3ffec-7110-4b4d-9482-2451914c166f/os-volume_attachments/1598106d-a439-42b7-b406-ce5a40120d83" status: 202 len: 0 microversion: 2.20 time: 0.498387 Jun 24 16:36:22.478314 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 212/449] 10.222.0.18 () {60 vars in 1456 bytes} [Fri Jun 24 16:36:21 2022] DELETE /compute/v2.1/servers/30b3ffec-7110-4b4d-9482-2451914c166f/os-volume_attachments/1598106d-a439-42b7-b406-ce5a40120d83 => generated 0 bytes in 501 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 24 16:36:22.500534 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-52c1f125-585b-422c-beba-3fc970325506 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Calling method '>' {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:36:22.503326 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-52c1f125-585b-422c-beba-3fc970325506 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] [instance: 30b3ffec-7110-4b4d-9482-2451914c166f] Fetching instance by UUID {{(pid=102149) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:36:22.527883 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-52c1f125-585b-422c-beba-3fc970325506 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:36:22.528218 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.wsgi [None req-348f23c0-1d99-494f-9e4b-bd6548a0cd8b tempest-VolumesSnapshotTestJSON-1294974655 tempest-VolumesSnapshotTestJSON-1294974655-project] HTTP exception thrown: Instance ebd2b19d-ddad-422b-a276-0fb7cbe80753 could not be found. Jun 24 16:36:22.528680 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-348f23c0-1d99-494f-9e4b-bd6548a0cd8b tempest-VolumesSnapshotTestJSON-1294974655 tempest-VolumesSnapshotTestJSON-1294974655-project] Returning 404 to user: Instance ebd2b19d-ddad-422b-a276-0fb7cbe80753 could not be found. {{(pid=102148) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jun 24 16:36:22.528841 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-52c1f125-585b-422c-beba-3fc970325506 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:36:22.529820 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-348f23c0-1d99-494f-9e4b-bd6548a0cd8b tempest-VolumesSnapshotTestJSON-1294974655 tempest-VolumesSnapshotTestJSON-1294974655-project] 10.222.0.18 "GET /compute/v2.1/servers/ebd2b19d-ddad-422b-a276-0fb7cbe80753" status: 404 len: 111 microversion: 2.1 time: 0.095228 Jun 24 16:36:22.530645 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-52c1f125-585b-422c-beba-3fc970325506 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:36:22.531759 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 238/450] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:36:22 2022] GET /compute/v2.1/servers/ebd2b19d-ddad-422b-a276-0fb7cbe80753 => generated 111 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 24 16:36:22.536726 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-52c1f125-585b-422c-beba-3fc970325506 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:36:22.695393 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-52c1f125-585b-422c-beba-3fc970325506 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] 10.222.0.18 "GET /compute/v2.1/servers/30b3ffec-7110-4b4d-9482-2451914c166f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.210958 Jun 24 16:36:22.696412 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 213/451] 10.222.0.18 () {60 vars in 1342 bytes} [Fri Jun 24 16:36:22 2022] GET /compute/v2.1/servers/30b3ffec-7110-4b4d-9482-2451914c166f/os-volume_attachments => generated 197 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 16:36:23.600989 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [req-99b6c714-1a4a-47de-a7c6-7b8f8dc80959 req-8f3e9a48-5b28-4ffb-a5f7-e1a61682570e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "41c16116-97cf-4394-8c41-2d57d447d422", "tag": "6ccb72c8-72c5-4467-a284-d1c79d49c232"}]} {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 16:36:23.603598 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 24 16:36:23.603598 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: warnings.warn(msg) Jun 24 16:36:23.618903 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [req-99b6c714-1a4a-47de-a7c6-7b8f8dc80959 req-8f3e9a48-5b28-4ffb-a5f7-e1a61682570e service nova] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:36:23.619354 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [req-99b6c714-1a4a-47de-a7c6-7b8f8dc80959 req-8f3e9a48-5b28-4ffb-a5f7-e1a61682570e service nova] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:36:23.636820 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.compute.server_external_events [req-99b6c714-1a4a-47de-a7c6-7b8f8dc80959 req-8f3e9a48-5b28-4ffb-a5f7-e1a61682570e service nova] Creating event network-changed:6ccb72c8-72c5-4467-a284-d1c79d49c232 for instance 41c16116-97cf-4394-8c41-2d57d447d422 on hv-cinder-84718 Jun 24 16:36:23.641838 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [req-99b6c714-1a4a-47de-a7c6-7b8f8dc80959 req-8f3e9a48-5b28-4ffb-a5f7-e1a61682570e service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047419 Jun 24 16:36:23.642539 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 239/452] 10.222.0.18 () {64 vars in 1317 bytes} [Fri Jun 24 16:36:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 16:36:23.708233 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-47410e7b-7c49-4b7f-877c-faf1369e9ed3 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Calling method '>' {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:36:23.710037 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-47410e7b-7c49-4b7f-877c-faf1369e9ed3 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] [instance: 30b3ffec-7110-4b4d-9482-2451914c166f] Fetching instance by UUID {{(pid=102149) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:36:23.720071 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-47410e7b-7c49-4b7f-877c-faf1369e9ed3 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:36:23.720637 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-47410e7b-7c49-4b7f-877c-faf1369e9ed3 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:36:23.721519 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-47410e7b-7c49-4b7f-877c-faf1369e9ed3 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:36:23.722032 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-47410e7b-7c49-4b7f-877c-faf1369e9ed3 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:36:23.810729 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-47410e7b-7c49-4b7f-877c-faf1369e9ed3 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] 10.222.0.18 "GET /compute/v2.1/servers/30b3ffec-7110-4b4d-9482-2451914c166f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.106453 Jun 24 16:36:23.811465 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 214/453] 10.222.0.18 () {60 vars in 1342 bytes} [Fri Jun 24 16:36:23 2022] GET /compute/v2.1/servers/30b3ffec-7110-4b4d-9482-2451914c166f/os-volume_attachments => generated 197 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 16:36:24.831026 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-3abce3e2-54b3-4be3-83fd-abe5075119d9 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Calling method '>' {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:36:24.832061 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-3abce3e2-54b3-4be3-83fd-abe5075119d9 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] [instance: 30b3ffec-7110-4b4d-9482-2451914c166f] Fetching instance by UUID {{(pid=102148) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:36:24.841927 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-3abce3e2-54b3-4be3-83fd-abe5075119d9 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:36:24.842668 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-3abce3e2-54b3-4be3-83fd-abe5075119d9 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:36:24.843708 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-3abce3e2-54b3-4be3-83fd-abe5075119d9 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:36:24.844254 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-3abce3e2-54b3-4be3-83fd-abe5075119d9 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:36:24.916260 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-3abce3e2-54b3-4be3-83fd-abe5075119d9 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] 10.222.0.18 "GET /compute/v2.1/servers/30b3ffec-7110-4b4d-9482-2451914c166f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.093837 Jun 24 16:36:24.916924 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 240/454] 10.222.0.18 () {60 vars in 1342 bytes} [Fri Jun 24 16:36:24 2022] GET /compute/v2.1/servers/30b3ffec-7110-4b4d-9482-2451914c166f/os-volume_attachments => generated 197 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 16:36:25.932263 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-d5fb86af-808e-49b5-ad4f-97dba83d0c6f tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Calling method '>' {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:36:25.933579 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-d5fb86af-808e-49b5-ad4f-97dba83d0c6f tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] [instance: 30b3ffec-7110-4b4d-9482-2451914c166f] Fetching instance by UUID {{(pid=102149) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:36:25.942227 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-d5fb86af-808e-49b5-ad4f-97dba83d0c6f tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:36:25.942922 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-d5fb86af-808e-49b5-ad4f-97dba83d0c6f tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:36:25.943807 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-d5fb86af-808e-49b5-ad4f-97dba83d0c6f tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:36:25.944462 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-d5fb86af-808e-49b5-ad4f-97dba83d0c6f tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:36:26.013179 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-d5fb86af-808e-49b5-ad4f-97dba83d0c6f tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] 10.222.0.18 "GET /compute/v2.1/servers/30b3ffec-7110-4b4d-9482-2451914c166f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.086645 Jun 24 16:36:26.013741 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 215/455] 10.222.0.18 () {60 vars in 1342 bytes} [Fri Jun 24 16:36:25 2022] GET /compute/v2.1/servers/30b3ffec-7110-4b4d-9482-2451914c166f/os-volume_attachments => generated 197 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 16:36:27.027688 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-58da06b8-fe16-4a52-a45f-094238491384 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Calling method '>' {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:36:27.028695 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-58da06b8-fe16-4a52-a45f-094238491384 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] [instance: 30b3ffec-7110-4b4d-9482-2451914c166f] Fetching instance by UUID {{(pid=102148) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:36:27.037225 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-58da06b8-fe16-4a52-a45f-094238491384 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:36:27.037678 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-58da06b8-fe16-4a52-a45f-094238491384 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:36:27.038671 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-58da06b8-fe16-4a52-a45f-094238491384 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:36:27.039153 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-58da06b8-fe16-4a52-a45f-094238491384 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:36:27.128043 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-58da06b8-fe16-4a52-a45f-094238491384 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] 10.222.0.18 "GET /compute/v2.1/servers/30b3ffec-7110-4b4d-9482-2451914c166f/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.106017 Jun 24 16:36:27.129034 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 241/456] 10.222.0.18 () {60 vars in 1342 bytes} [Fri Jun 24 16:36:27 2022] GET /compute/v2.1/servers/30b3ffec-7110-4b4d-9482-2451914c166f/os-volume_attachments => generated 25 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 16:36:27.235533 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-61a5a2be-dd5e-4184-a07e-6cb588335a25 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Calling method '>' {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:36:27.236704 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-61a5a2be-dd5e-4184-a07e-6cb588335a25 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] [instance: 30b3ffec-7110-4b4d-9482-2451914c166f] Fetching instance by UUID {{(pid=102149) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:36:27.248065 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-61a5a2be-dd5e-4184-a07e-6cb588335a25 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:36:27.249416 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-61a5a2be-dd5e-4184-a07e-6cb588335a25 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:36:27.250635 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-61a5a2be-dd5e-4184-a07e-6cb588335a25 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:36:27.251340 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-61a5a2be-dd5e-4184-a07e-6cb588335a25 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:36:27.338176 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-61a5a2be-dd5e-4184-a07e-6cb588335a25 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] [instance: 30b3ffec-7110-4b4d-9482-2451914c166f] Going to try to terminate instance {{(pid=102149) delete /opt/stack/nova/nova/compute/api.py:2562}} Jun 24 16:36:27.529558 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-61a5a2be-dd5e-4184-a07e-6cb588335a25 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] 10.222.0.18 "DELETE /compute/v2.1/servers/30b3ffec-7110-4b4d-9482-2451914c166f" status: 204 len: 0 microversion: 2.20 time: 0.298125 Jun 24 16:36:27.530627 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 216/457] 10.222.0.18 () {60 vars in 1279 bytes} [Fri Jun 24 16:36:27 2022] DELETE /compute/v2.1/servers/30b3ffec-7110-4b4d-9482-2451914c166f => generated 0 bytes in 301 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 24 16:36:27.547224 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-8775f61d-8ce5-4ef1-aa5b-35951b5fc626 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Calling method '>' {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:36:27.548358 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-8775f61d-8ce5-4ef1-aa5b-35951b5fc626 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] [instance: 30b3ffec-7110-4b4d-9482-2451914c166f] Fetching instance by UUID {{(pid=102148) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:36:27.562022 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-8775f61d-8ce5-4ef1-aa5b-35951b5fc626 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:36:27.563219 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-8775f61d-8ce5-4ef1-aa5b-35951b5fc626 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:36:27.564799 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-8775f61d-8ce5-4ef1-aa5b-35951b5fc626 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:36:27.565552 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-8775f61d-8ce5-4ef1-aa5b-35951b5fc626 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:36:27.885902 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-8775f61d-8ce5-4ef1-aa5b-35951b5fc626 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7489b29cb3ef47d78dfd55794f338b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065254ebe67545639644fcbc6bd9fc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:36:27.895014 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-8775f61d-8ce5-4ef1-aa5b-35951b5fc626 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7489b29cb3ef47d78dfd55794f338b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065254ebe67545639644fcbc6bd9fc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:36:27.896533 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-8775f61d-8ce5-4ef1-aa5b-35951b5fc626 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7489b29cb3ef47d78dfd55794f338b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065254ebe67545639644fcbc6bd9fc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:36:27.897682 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-8775f61d-8ce5-4ef1-aa5b-35951b5fc626 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] 10.222.0.18 "GET /compute/v2.1/servers/30b3ffec-7110-4b4d-9482-2451914c166f" status: 200 len: 1722 microversion: 2.20 time: 0.361130 Jun 24 16:36:27.898231 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 242/458] 10.222.0.18 () {60 vars in 1276 bytes} [Fri Jun 24 16:36:27 2022] GET /compute/v2.1/servers/30b3ffec-7110-4b4d-9482-2451914c166f => generated 1722 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 16:36:28.919281 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-4c8edf8a-7674-41b7-9106-7c757677bfae tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Calling method '>' {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:36:28.919990 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-4c8edf8a-7674-41b7-9106-7c757677bfae tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] [instance: 30b3ffec-7110-4b4d-9482-2451914c166f] Fetching instance by UUID {{(pid=102149) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:36:28.929917 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-4c8edf8a-7674-41b7-9106-7c757677bfae tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:36:28.930340 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-4c8edf8a-7674-41b7-9106-7c757677bfae tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:36:28.931115 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-4c8edf8a-7674-41b7-9106-7c757677bfae tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:36:28.931553 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-4c8edf8a-7674-41b7-9106-7c757677bfae tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:36:29.264277 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-4c8edf8a-7674-41b7-9106-7c757677bfae tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7489b29cb3ef47d78dfd55794f338b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065254ebe67545639644fcbc6bd9fc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:36:29.281418 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-4c8edf8a-7674-41b7-9106-7c757677bfae tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7489b29cb3ef47d78dfd55794f338b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065254ebe67545639644fcbc6bd9fc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:36:29.284379 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-4c8edf8a-7674-41b7-9106-7c757677bfae tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7489b29cb3ef47d78dfd55794f338b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065254ebe67545639644fcbc6bd9fc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:36:29.286594 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-4c8edf8a-7674-41b7-9106-7c757677bfae tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] 10.222.0.18 "GET /compute/v2.1/servers/30b3ffec-7110-4b4d-9482-2451914c166f" status: 200 len: 1722 microversion: 2.20 time: 0.373312 Jun 24 16:36:29.287610 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 217/459] 10.222.0.18 () {60 vars in 1276 bytes} [Fri Jun 24 16:36:28 2022] GET /compute/v2.1/servers/30b3ffec-7110-4b4d-9482-2451914c166f => generated 1722 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 16:36:30.319799 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-9ff7ab17-392e-4d05-8c2c-bc305cf04fea tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Calling method '>' {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:36:30.320910 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-9ff7ab17-392e-4d05-8c2c-bc305cf04fea tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] [instance: 30b3ffec-7110-4b4d-9482-2451914c166f] Fetching instance by UUID {{(pid=102148) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:36:30.334098 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-9ff7ab17-392e-4d05-8c2c-bc305cf04fea tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:36:30.335504 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-9ff7ab17-392e-4d05-8c2c-bc305cf04fea tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:36:30.336916 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-9ff7ab17-392e-4d05-8c2c-bc305cf04fea tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:36:30.337703 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-9ff7ab17-392e-4d05-8c2c-bc305cf04fea tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:36:30.642677 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-9ff7ab17-392e-4d05-8c2c-bc305cf04fea tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7489b29cb3ef47d78dfd55794f338b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065254ebe67545639644fcbc6bd9fc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:36:30.658161 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-9ff7ab17-392e-4d05-8c2c-bc305cf04fea tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7489b29cb3ef47d78dfd55794f338b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065254ebe67545639644fcbc6bd9fc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:36:30.660747 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-9ff7ab17-392e-4d05-8c2c-bc305cf04fea tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7489b29cb3ef47d78dfd55794f338b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065254ebe67545639644fcbc6bd9fc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:36:30.661916 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-9ff7ab17-392e-4d05-8c2c-bc305cf04fea tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] 10.222.0.18 "GET /compute/v2.1/servers/30b3ffec-7110-4b4d-9482-2451914c166f" status: 200 len: 1722 microversion: 2.20 time: 0.349141 Jun 24 16:36:30.662474 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 243/460] 10.222.0.18 () {60 vars in 1276 bytes} [Fri Jun 24 16:36:30 2022] GET /compute/v2.1/servers/30b3ffec-7110-4b4d-9482-2451914c166f => generated 1722 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 16:36:31.807148 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-b2b9fa70-fe82-410c-b251-0758295e0a25 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Calling method '>' {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:36:31.808195 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-b2b9fa70-fe82-410c-b251-0758295e0a25 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] [instance: 30b3ffec-7110-4b4d-9482-2451914c166f] Fetching instance by UUID {{(pid=102149) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:36:31.821128 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-b2b9fa70-fe82-410c-b251-0758295e0a25 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:36:31.821799 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-b2b9fa70-fe82-410c-b251-0758295e0a25 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:36:31.823138 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-b2b9fa70-fe82-410c-b251-0758295e0a25 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:36:31.823892 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-b2b9fa70-fe82-410c-b251-0758295e0a25 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:36:32.114385 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-b2b9fa70-fe82-410c-b251-0758295e0a25 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7489b29cb3ef47d78dfd55794f338b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065254ebe67545639644fcbc6bd9fc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:36:32.128043 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-b2b9fa70-fe82-410c-b251-0758295e0a25 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7489b29cb3ef47d78dfd55794f338b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065254ebe67545639644fcbc6bd9fc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:36:32.130063 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-b2b9fa70-fe82-410c-b251-0758295e0a25 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7489b29cb3ef47d78dfd55794f338b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065254ebe67545639644fcbc6bd9fc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:36:32.131077 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-b2b9fa70-fe82-410c-b251-0758295e0a25 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] 10.222.0.18 "GET /compute/v2.1/servers/30b3ffec-7110-4b4d-9482-2451914c166f" status: 200 len: 1722 microversion: 2.20 time: 0.445665 Jun 24 16:36:32.138781 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 218/461] 10.222.0.18 () {60 vars in 1276 bytes} [Fri Jun 24 16:36:31 2022] GET /compute/v2.1/servers/30b3ffec-7110-4b4d-9482-2451914c166f => generated 1722 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 16:36:33.152029 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-dab28342-4646-4d18-9451-ae3263e490e1 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Calling method '>' {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:36:33.152944 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-dab28342-4646-4d18-9451-ae3263e490e1 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] [instance: 30b3ffec-7110-4b4d-9482-2451914c166f] Fetching instance by UUID {{(pid=102148) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:36:33.161316 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-dab28342-4646-4d18-9451-ae3263e490e1 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:36:33.161893 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-dab28342-4646-4d18-9451-ae3263e490e1 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:36:33.163671 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-dab28342-4646-4d18-9451-ae3263e490e1 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:36:33.164255 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-dab28342-4646-4d18-9451-ae3263e490e1 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:36:33.415156 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-4df014f9-8c7d-4ad8-bb3f-549268464dc5 tempest-VolumesSnapshotTestJSON-1294974655 tempest-VolumesSnapshotTestJSON-1294974655-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-296171879", "imageRef": "113c9cfb-6cee-4018-9e63-66fae82b3851", "flavorRef": "452", "networks": [{"uuid": "9e95becd-dade-458e-967f-348562028446"}]}} {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 16:36:33.512091 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.network.neutron [None req-4df014f9-8c7d-4ad8-bb3f-549268464dc5 tempest-VolumesSnapshotTestJSON-1294974655 tempest-VolumesSnapshotTestJSON-1294974655-project] validate_networks() for [('9e95becd-dade-458e-967f-348562028446', None, None, None)] {{(pid=102149) validate_networks /opt/stack/nova/nova/network/neutron.py:2367}} Jun 24 16:36:33.931275 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-dab28342-4646-4d18-9451-ae3263e490e1 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7489b29cb3ef47d78dfd55794f338b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065254ebe67545639644fcbc6bd9fc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:36:33.940636 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-dab28342-4646-4d18-9451-ae3263e490e1 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7489b29cb3ef47d78dfd55794f338b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065254ebe67545639644fcbc6bd9fc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:36:33.942145 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-dab28342-4646-4d18-9451-ae3263e490e1 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7489b29cb3ef47d78dfd55794f338b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065254ebe67545639644fcbc6bd9fc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:36:33.943676 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-dab28342-4646-4d18-9451-ae3263e490e1 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] 10.222.0.18 "GET /compute/v2.1/servers/30b3ffec-7110-4b4d-9482-2451914c166f" status: 200 len: 1722 microversion: 2.20 time: 0.797456 Jun 24 16:36:33.944293 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 244/462] 10.222.0.18 () {60 vars in 1276 bytes} [Fri Jun 24 16:36:33 2022] GET /compute/v2.1/servers/30b3ffec-7110-4b4d-9482-2451914c166f => generated 1722 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 16:36:34.466135 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-21ecf0fe-c6b7-4636-8baf-4c1ad1f0562a tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-696964484", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-2130265802", "security_groups": [{"name": "tempest-secgroup-smoke-1952853768"}], "networks": [{"uuid": "d17a863c-a81e-4c59-a7bb-78257dd93ed2"}], "block_device_mapping_v2": [{"uuid": "66051b36-6084-4823-9cf3-93906b4201ce", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 16:36:34.810190 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.virt.hardware [None req-4df014f9-8c7d-4ad8-bb3f-549268464dc5 tempest-VolumesSnapshotTestJSON-1294974655 tempest-VolumesSnapshotTestJSON-1294974655-project] Flavor limits 0:0:0 {{(pid=102149) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 24 16:36:34.811036 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.virt.hardware [None req-4df014f9-8c7d-4ad8-bb3f-549268464dc5 tempest-VolumesSnapshotTestJSON-1294974655 tempest-VolumesSnapshotTestJSON-1294974655-project] Image limits 0:0:0 {{(pid=102149) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 24 16:36:34.812082 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.virt.hardware [None req-4df014f9-8c7d-4ad8-bb3f-549268464dc5 tempest-VolumesSnapshotTestJSON-1294974655 tempest-VolumesSnapshotTestJSON-1294974655-project] Flavor pref 0:0:0 {{(pid=102149) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 24 16:36:34.812903 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.virt.hardware [None req-4df014f9-8c7d-4ad8-bb3f-549268464dc5 tempest-VolumesSnapshotTestJSON-1294974655 tempest-VolumesSnapshotTestJSON-1294974655-project] Image pref 0:0:0 {{(pid=102149) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 24 16:36:34.813659 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.virt.hardware [None req-4df014f9-8c7d-4ad8-bb3f-549268464dc5 tempest-VolumesSnapshotTestJSON-1294974655 tempest-VolumesSnapshotTestJSON-1294974655-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=102149) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 24 16:36:34.825388 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-4df014f9-8c7d-4ad8-bb3f-549268464dc5 tempest-VolumesSnapshotTestJSON-1294974655 tempest-VolumesSnapshotTestJSON-1294974655-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:36:34.826205 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-4df014f9-8c7d-4ad8-bb3f-549268464dc5 tempest-VolumesSnapshotTestJSON-1294974655 tempest-VolumesSnapshotTestJSON-1294974655-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:36:34.828144 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-4df014f9-8c7d-4ad8-bb3f-549268464dc5 tempest-VolumesSnapshotTestJSON-1294974655 tempest-VolumesSnapshotTestJSON-1294974655-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:36:34.828458 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-4df014f9-8c7d-4ad8-bb3f-549268464dc5 tempest-VolumesSnapshotTestJSON-1294974655 tempest-VolumesSnapshotTestJSON-1294974655-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:36:34.855456 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.quota [None req-4df014f9-8c7d-4ad8-bb3f-549268464dc5 tempest-VolumesSnapshotTestJSON-1294974655 tempest-VolumesSnapshotTestJSON-1294974655-project] Getting quotas for project de0966981b5f4c3fa17c73c0c4b31779. Resources: {'ram', 'instances', 'cores'} {{(pid=102149) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jun 24 16:36:34.861910 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.quota [None req-4df014f9-8c7d-4ad8-bb3f-549268464dc5 tempest-VolumesSnapshotTestJSON-1294974655 tempest-VolumesSnapshotTestJSON-1294974655-project] Getting quotas for user a7b98bac241449c9a8b14307e4f7993a and project de0966981b5f4c3fa17c73c0c4b31779. Resources: {'ram', 'instances', 'cores'} {{(pid=102149) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jun 24 16:36:34.880093 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-4df014f9-8c7d-4ad8-bb3f-549268464dc5 tempest-VolumesSnapshotTestJSON-1294974655 tempest-VolumesSnapshotTestJSON-1294974655-project] Going to run 1 instances... {{(pid=102149) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Jun 24 16:36:34.884966 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-4df014f9-8c7d-4ad8-bb3f-549268464dc5 tempest-VolumesSnapshotTestJSON-1294974655 tempest-VolumesSnapshotTestJSON-1294974655-project] [instance: 6eb54c20-7da4-4c74-84fa-bc8e02d41498] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='113c9cfb-6cee-4018-9e63-66fae82b3851',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=102149) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1684}} Jun 24 16:36:34.899711 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.network.neutron [None req-21ecf0fe-c6b7-4636-8baf-4c1ad1f0562a tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] validate_networks() for [('d17a863c-a81e-4c59-a7bb-78257dd93ed2', None, None, None)] {{(pid=102148) validate_networks /opt/stack/nova/nova/network/neutron.py:2367}} Jun 24 16:36:34.957025 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-4df014f9-8c7d-4ad8-bb3f-549268464dc5 tempest-VolumesSnapshotTestJSON-1294974655 tempest-VolumesSnapshotTestJSON-1294974655-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.547114 Jun 24 16:36:34.958166 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 219/463] 10.222.0.18 () {60 vars in 1146 bytes} [Fri Jun 24 16:36:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 1550 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 24 16:36:34.974026 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-ddaf15e1-4e53-40b6-b34b-770500ad93bb tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Calling method '>' {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:36:34.975166 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-ddaf15e1-4e53-40b6-b34b-770500ad93bb tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] [instance: 30b3ffec-7110-4b4d-9482-2451914c166f] Fetching instance by UUID {{(pid=102149) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:36:34.993183 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-ddaf15e1-4e53-40b6-b34b-770500ad93bb tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:36:34.994106 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-ddaf15e1-4e53-40b6-b34b-770500ad93bb tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:36:34.995511 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-ddaf15e1-4e53-40b6-b34b-770500ad93bb tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:36:34.996269 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-ddaf15e1-4e53-40b6-b34b-770500ad93bb tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:36:35.245211 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-ddaf15e1-4e53-40b6-b34b-770500ad93bb tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7489b29cb3ef47d78dfd55794f338b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065254ebe67545639644fcbc6bd9fc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:36:35.263487 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-ddaf15e1-4e53-40b6-b34b-770500ad93bb tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7489b29cb3ef47d78dfd55794f338b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065254ebe67545639644fcbc6bd9fc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:36:35.266735 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-ddaf15e1-4e53-40b6-b34b-770500ad93bb tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7489b29cb3ef47d78dfd55794f338b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065254ebe67545639644fcbc6bd9fc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:36:35.269070 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-ddaf15e1-4e53-40b6-b34b-770500ad93bb tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] 10.222.0.18 "GET /compute/v2.1/servers/30b3ffec-7110-4b4d-9482-2451914c166f" status: 200 len: 1654 microversion: 2.20 time: 0.302274 Jun 24 16:36:35.270839 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 220/464] 10.222.0.18 () {60 vars in 1276 bytes} [Fri Jun 24 16:36:34 2022] GET /compute/v2.1/servers/30b3ffec-7110-4b4d-9482-2451914c166f => generated 1654 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 16:36:35.281504 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-1a107157-f7aa-49c7-b2cd-7cd2304ef41d tempest-VolumesSnapshotTestJSON-1294974655 tempest-VolumesSnapshotTestJSON-1294974655-project] Calling method '>' {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:36:35.283107 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-1a107157-f7aa-49c7-b2cd-7cd2304ef41d tempest-VolumesSnapshotTestJSON-1294974655 tempest-VolumesSnapshotTestJSON-1294974655-project] [instance: 6eb54c20-7da4-4c74-84fa-bc8e02d41498] Fetching instance by UUID {{(pid=102149) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:36:35.467323 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-1a107157-f7aa-49c7-b2cd-7cd2304ef41d tempest-VolumesSnapshotTestJSON-1294974655 tempest-VolumesSnapshotTestJSON-1294974655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7b98bac241449c9a8b14307e4f7993a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0966981b5f4c3fa17c73c0c4b31779', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:36:35.484619 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-1a107157-f7aa-49c7-b2cd-7cd2304ef41d tempest-VolumesSnapshotTestJSON-1294974655 tempest-VolumesSnapshotTestJSON-1294974655-project] 10.222.0.18 "GET /compute/v2.1/servers/6eb54c20-7da4-4c74-84fa-bc8e02d41498" status: 200 len: 1218 microversion: 2.1 time: 0.210937 Jun 24 16:36:35.485311 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 221/465] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:36:35 2022] GET /compute/v2.1/servers/6eb54c20-7da4-4c74-84fa-bc8e02d41498 => generated 1218 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 16:36:35.915772 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [req-f1fb0356-5570-42f5-8fb9-9f8a040df031 req-e87887a7-67b5-408e-8f83-1b617814cf3a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "30b3ffec-7110-4b4d-9482-2451914c166f", "name": "network-vif-deleted", "tag": "78a4e31b-a598-4436-bdeb-0904cefd7b6e"}]} {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 16:36:35.920365 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 24 16:36:35.920365 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: warnings.warn(msg) Jun 24 16:36:35.938329 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [req-f1fb0356-5570-42f5-8fb9-9f8a040df031 req-e87887a7-67b5-408e-8f83-1b617814cf3a service nova] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:36:35.939222 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [req-f1fb0356-5570-42f5-8fb9-9f8a040df031 req-e87887a7-67b5-408e-8f83-1b617814cf3a service nova] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:36:35.972162 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.compute.server_external_events [req-f1fb0356-5570-42f5-8fb9-9f8a040df031 req-e87887a7-67b5-408e-8f83-1b617814cf3a service nova] Creating event network-vif-deleted:78a4e31b-a598-4436-bdeb-0904cefd7b6e for instance 30b3ffec-7110-4b4d-9482-2451914c166f on hv-cinder-84718 Jun 24 16:36:35.982388 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [req-f1fb0356-5570-42f5-8fb9-9f8a040df031 req-e87887a7-67b5-408e-8f83-1b617814cf3a service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085953 Jun 24 16:36:35.984237 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 222/466] 10.222.0.18 () {64 vars in 1317 bytes} [Fri Jun 24 16:36:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 16:36:36.310030 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-ba9bd00a-0cf7-4021-b17f-bee7e4a6e063 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Calling method '>' {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:36:36.311678 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-ba9bd00a-0cf7-4021-b17f-bee7e4a6e063 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] [instance: 30b3ffec-7110-4b4d-9482-2451914c166f] Fetching instance by UUID {{(pid=102149) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:36:36.323467 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-ba9bd00a-0cf7-4021-b17f-bee7e4a6e063 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:36:36.324354 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-ba9bd00a-0cf7-4021-b17f-bee7e4a6e063 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:36:36.326513 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-ba9bd00a-0cf7-4021-b17f-bee7e4a6e063 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:36:36.327175 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-ba9bd00a-0cf7-4021-b17f-bee7e4a6e063 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:36:36.328437 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.virt.hardware [None req-21ecf0fe-c6b7-4636-8baf-4c1ad1f0562a tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] Flavor limits 0:0:0 {{(pid=102148) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 24 16:36:36.329200 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.virt.hardware [None req-21ecf0fe-c6b7-4636-8baf-4c1ad1f0562a tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] Image limits 0:0:0 {{(pid=102148) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 24 16:36:36.330327 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.virt.hardware [None req-21ecf0fe-c6b7-4636-8baf-4c1ad1f0562a tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] Flavor pref 0:0:0 {{(pid=102148) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 24 16:36:36.331106 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.virt.hardware [None req-21ecf0fe-c6b7-4636-8baf-4c1ad1f0562a tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] Image pref 0:0:0 {{(pid=102148) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 24 16:36:36.331857 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.virt.hardware [None req-21ecf0fe-c6b7-4636-8baf-4c1ad1f0562a tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=102148) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 24 16:36:36.347517 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-21ecf0fe-c6b7-4636-8baf-4c1ad1f0562a tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:36:36.348414 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-21ecf0fe-c6b7-4636-8baf-4c1ad1f0562a tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:36:36.349635 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-21ecf0fe-c6b7-4636-8baf-4c1ad1f0562a tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:36:36.350970 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-21ecf0fe-c6b7-4636-8baf-4c1ad1f0562a tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:36:36.373758 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.quota [None req-21ecf0fe-c6b7-4636-8baf-4c1ad1f0562a tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] Getting quotas for project a34b225f93234ca38c8d0c3d37ba0b8f. Resources: {'ram', 'instances', 'cores'} {{(pid=102148) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jun 24 16:36:36.378811 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.quota [None req-21ecf0fe-c6b7-4636-8baf-4c1ad1f0562a tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] Getting quotas for user 0b823267a02a465192aadb5a1c5a3d92 and project a34b225f93234ca38c8d0c3d37ba0b8f. Resources: {'ram', 'instances', 'cores'} {{(pid=102148) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jun 24 16:36:36.411303 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-ba9bd00a-0cf7-4021-b17f-bee7e4a6e063 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:36:36.411873 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-ba9bd00a-0cf7-4021-b17f-bee7e4a6e063 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:36:36.412628 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.objects.instance [None req-ba9bd00a-0cf7-4021-b17f-bee7e4a6e063 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lazy-loading 'fault' on Instance uuid 30b3ffec-7110-4b4d-9482-2451914c166f {{(pid=102149) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Jun 24 16:36:36.519493 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-21ecf0fe-c6b7-4636-8baf-4c1ad1f0562a tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] Going to run 1 instances... {{(pid=102148) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Jun 24 16:36:36.522935 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-21ecf0fe-c6b7-4636-8baf-4c1ad1f0562a tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] [instance: bd57f4a8-0078-4dde-ac34-901a40bc7b8e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='66051b36-6084-4823-9cf3-93906b4201ce',volume_size=None,volume_type=None)] {{(pid=102148) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1684}} Jun 24 16:36:36.622348 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-ba9bd00a-0cf7-4021-b17f-bee7e4a6e063 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7489b29cb3ef47d78dfd55794f338b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065254ebe67545639644fcbc6bd9fc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:36:36.646164 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-ba9bd00a-0cf7-4021-b17f-bee7e4a6e063 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7489b29cb3ef47d78dfd55794f338b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065254ebe67545639644fcbc6bd9fc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:36:36.652295 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-ba9bd00a-0cf7-4021-b17f-bee7e4a6e063 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7489b29cb3ef47d78dfd55794f338b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065254ebe67545639644fcbc6bd9fc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:36:36.663690 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-ba9bd00a-0cf7-4021-b17f-bee7e4a6e063 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] 10.222.0.18 "GET /compute/v2.1/servers/30b3ffec-7110-4b4d-9482-2451914c166f" status: 200 len: 1370 microversion: 2.20 time: 0.358274 Jun 24 16:36:36.665405 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 223/467] 10.222.0.18 () {60 vars in 1276 bytes} [Fri Jun 24 16:36:36 2022] GET /compute/v2.1/servers/30b3ffec-7110-4b4d-9482-2451914c166f => generated 1370 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 16:36:36.686109 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-19c19ca0-70bd-4dd7-bce5-7b214d68bffc tempest-VolumesSnapshotTestJSON-1294974655 tempest-VolumesSnapshotTestJSON-1294974655-project] Calling method '>' {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:36:36.687900 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-19c19ca0-70bd-4dd7-bce5-7b214d68bffc tempest-VolumesSnapshotTestJSON-1294974655 tempest-VolumesSnapshotTestJSON-1294974655-project] [instance: 6eb54c20-7da4-4c74-84fa-bc8e02d41498] Fetching instance by UUID {{(pid=102149) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:36:36.701328 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-19c19ca0-70bd-4dd7-bce5-7b214d68bffc tempest-VolumesSnapshotTestJSON-1294974655 tempest-VolumesSnapshotTestJSON-1294974655-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:36:36.702568 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-19c19ca0-70bd-4dd7-bce5-7b214d68bffc tempest-VolumesSnapshotTestJSON-1294974655 tempest-VolumesSnapshotTestJSON-1294974655-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:36:36.703893 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-19c19ca0-70bd-4dd7-bce5-7b214d68bffc tempest-VolumesSnapshotTestJSON-1294974655 tempest-VolumesSnapshotTestJSON-1294974655-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:36:36.704956 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-19c19ca0-70bd-4dd7-bce5-7b214d68bffc tempest-VolumesSnapshotTestJSON-1294974655 tempest-VolumesSnapshotTestJSON-1294974655-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:36:36.908131 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-21ecf0fe-c6b7-4636-8baf-4c1ad1f0562a tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 2.448481 Jun 24 16:36:36.919891 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 245/468] 10.222.0.18 () {60 vars in 1146 bytes} [Fri Jun 24 16:36:34 2022] POST /compute/v2.1/servers => generated 406 bytes in 2461 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 24 16:36:36.930896 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-49d44fcd-56eb-4fab-b8b1-6fc8f3843fee tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] Calling method '>' {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:36:36.932504 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-49d44fcd-56eb-4fab-b8b1-6fc8f3843fee tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] [instance: bd57f4a8-0078-4dde-ac34-901a40bc7b8e] Fetching instance by UUID {{(pid=102148) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:36:36.945179 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-19c19ca0-70bd-4dd7-bce5-7b214d68bffc tempest-VolumesSnapshotTestJSON-1294974655 tempest-VolumesSnapshotTestJSON-1294974655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7b98bac241449c9a8b14307e4f7993a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0966981b5f4c3fa17c73c0c4b31779', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:36:36.957762 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-19c19ca0-70bd-4dd7-bce5-7b214d68bffc tempest-VolumesSnapshotTestJSON-1294974655 tempest-VolumesSnapshotTestJSON-1294974655-project] 10.222.0.18 "GET /compute/v2.1/servers/6eb54c20-7da4-4c74-84fa-bc8e02d41498" status: 200 len: 1270 microversion: 2.1 time: 0.290655 Jun 24 16:36:36.958426 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 224/469] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:36:36 2022] GET /compute/v2.1/servers/6eb54c20-7da4-4c74-84fa-bc8e02d41498 => generated 1270 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 16:36:37.071815 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-49d44fcd-56eb-4fab-b8b1-6fc8f3843fee tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b823267a02a465192aadb5a1c5a3d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34b225f93234ca38c8d0c3d37ba0b8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:36:37.086754 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-49d44fcd-56eb-4fab-b8b1-6fc8f3843fee tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] 10.222.0.18 "GET /compute/v2.1/servers/bd57f4a8-0078-4dde-ac34-901a40bc7b8e" status: 200 len: 1088 microversion: 2.1 time: 0.164635 Jun 24 16:36:37.099422 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 246/470] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:36:36 2022] GET /compute/v2.1/servers/bd57f4a8-0078-4dde-ac34-901a40bc7b8e => generated 1088 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 16:36:37.695277 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-2661fe70-5742-4f77-96b3-cb008e2c2066 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Calling method '>' {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:36:37.696589 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-2661fe70-5742-4f77-96b3-cb008e2c2066 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] [instance: 30b3ffec-7110-4b4d-9482-2451914c166f] Fetching instance by UUID {{(pid=102149) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:36:37.712266 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-2661fe70-5742-4f77-96b3-cb008e2c2066 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:36:37.714547 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-2661fe70-5742-4f77-96b3-cb008e2c2066 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:36:37.717614 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-2661fe70-5742-4f77-96b3-cb008e2c2066 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:36:37.718415 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-2661fe70-5742-4f77-96b3-cb008e2c2066 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:36:37.805818 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.wsgi [None req-2661fe70-5742-4f77-96b3-cb008e2c2066 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] HTTP exception thrown: Instance 30b3ffec-7110-4b4d-9482-2451914c166f could not be found. Jun 24 16:36:37.807021 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-2661fe70-5742-4f77-96b3-cb008e2c2066 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Returning 404 to user: Instance 30b3ffec-7110-4b4d-9482-2451914c166f could not be found. {{(pid=102149) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jun 24 16:36:37.808593 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-2661fe70-5742-4f77-96b3-cb008e2c2066 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] 10.222.0.18 "GET /compute/v2.1/servers/30b3ffec-7110-4b4d-9482-2451914c166f" status: 404 len: 111 microversion: 2.20 time: 0.126165 Jun 24 16:36:37.810635 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 225/471] 10.222.0.18 () {60 vars in 1276 bytes} [Fri Jun 24 16:36:37 2022] GET /compute/v2.1/servers/30b3ffec-7110-4b4d-9482-2451914c166f => generated 111 bytes in 130 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 24 16:36:37.819340 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-3faa2cc4-03dc-4315-97f5-f44c81d912a7 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Calling method '.version_select at 0x7f1ae8d48ee0>' {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:36:37.851365 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-3faa2cc4-03dc-4315-97f5-f44c81d912a7 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-116280810" status: 204 len: 0 microversion: 2.20 time: 0.035418 Jun 24 16:36:37.852482 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 247/472] 10.222.0.18 () {60 vars in 1258 bytes} [Fri Jun 24 16:36:37 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-116280810 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jun 24 16:36:37.980954 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-e8ac4a36-4925-4b5d-9010-6486a7847462 tempest-VolumesSnapshotTestJSON-1294974655 tempest-VolumesSnapshotTestJSON-1294974655-project] Calling method '>' {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:36:37.982061 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-e8ac4a36-4925-4b5d-9010-6486a7847462 tempest-VolumesSnapshotTestJSON-1294974655 tempest-VolumesSnapshotTestJSON-1294974655-project] [instance: 6eb54c20-7da4-4c74-84fa-bc8e02d41498] Fetching instance by UUID {{(pid=102149) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:36:37.995314 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-e8ac4a36-4925-4b5d-9010-6486a7847462 tempest-VolumesSnapshotTestJSON-1294974655 tempest-VolumesSnapshotTestJSON-1294974655-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:36:37.995626 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-e8ac4a36-4925-4b5d-9010-6486a7847462 tempest-VolumesSnapshotTestJSON-1294974655 tempest-VolumesSnapshotTestJSON-1294974655-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:36:37.996430 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-e8ac4a36-4925-4b5d-9010-6486a7847462 tempest-VolumesSnapshotTestJSON-1294974655 tempest-VolumesSnapshotTestJSON-1294974655-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:36:37.997035 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-e8ac4a36-4925-4b5d-9010-6486a7847462 tempest-VolumesSnapshotTestJSON-1294974655 tempest-VolumesSnapshotTestJSON-1294974655-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:36:38.110622 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-5c36ad71-3aa0-4b97-af6d-59515bbced86 tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] Calling method '>' {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:36:38.112290 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-5c36ad71-3aa0-4b97-af6d-59515bbced86 tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] [instance: bd57f4a8-0078-4dde-ac34-901a40bc7b8e] Fetching instance by UUID {{(pid=102148) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:36:38.127818 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-5c36ad71-3aa0-4b97-af6d-59515bbced86 tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:36:38.128608 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-5c36ad71-3aa0-4b97-af6d-59515bbced86 tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:36:38.131050 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-5c36ad71-3aa0-4b97-af6d-59515bbced86 tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:36:38.132271 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-5c36ad71-3aa0-4b97-af6d-59515bbced86 tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:36:38.176175 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-e8ac4a36-4925-4b5d-9010-6486a7847462 tempest-VolumesSnapshotTestJSON-1294974655 tempest-VolumesSnapshotTestJSON-1294974655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7b98bac241449c9a8b14307e4f7993a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0966981b5f4c3fa17c73c0c4b31779', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:36:38.198597 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-e8ac4a36-4925-4b5d-9010-6486a7847462 tempest-VolumesSnapshotTestJSON-1294974655 tempest-VolumesSnapshotTestJSON-1294974655-project] 10.222.0.18 "GET /compute/v2.1/servers/6eb54c20-7da4-4c74-84fa-bc8e02d41498" status: 200 len: 1276 microversion: 2.1 time: 0.225169 Jun 24 16:36:38.200617 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 226/473] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:36:37 2022] GET /compute/v2.1/servers/6eb54c20-7da4-4c74-84fa-bc8e02d41498 => generated 1276 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 16:36:38.343478 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-5c36ad71-3aa0-4b97-af6d-59515bbced86 tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b823267a02a465192aadb5a1c5a3d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34b225f93234ca38c8d0c3d37ba0b8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:36:38.355078 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-5c36ad71-3aa0-4b97-af6d-59515bbced86 tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] 10.222.0.18 "GET /compute/v2.1/servers/bd57f4a8-0078-4dde-ac34-901a40bc7b8e" status: 200 len: 1186 microversion: 2.1 time: 0.250896 Jun 24 16:36:38.368808 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 248/474] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:36:38 2022] GET /compute/v2.1/servers/bd57f4a8-0078-4dde-ac34-901a40bc7b8e => generated 1186 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 16:36:39.218057 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-80ab48b1-513a-495d-b184-c68cb6dd3d4e tempest-VolumesSnapshotTestJSON-1294974655 tempest-VolumesSnapshotTestJSON-1294974655-project] Calling method '>' {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:36:39.219537 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-80ab48b1-513a-495d-b184-c68cb6dd3d4e tempest-VolumesSnapshotTestJSON-1294974655 tempest-VolumesSnapshotTestJSON-1294974655-project] [instance: 6eb54c20-7da4-4c74-84fa-bc8e02d41498] Fetching instance by UUID {{(pid=102149) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:36:39.229400 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-80ab48b1-513a-495d-b184-c68cb6dd3d4e tempest-VolumesSnapshotTestJSON-1294974655 tempest-VolumesSnapshotTestJSON-1294974655-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:36:39.229842 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-80ab48b1-513a-495d-b184-c68cb6dd3d4e tempest-VolumesSnapshotTestJSON-1294974655 tempest-VolumesSnapshotTestJSON-1294974655-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:36:39.230911 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-80ab48b1-513a-495d-b184-c68cb6dd3d4e tempest-VolumesSnapshotTestJSON-1294974655 tempest-VolumesSnapshotTestJSON-1294974655-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:36:39.231566 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-80ab48b1-513a-495d-b184-c68cb6dd3d4e tempest-VolumesSnapshotTestJSON-1294974655 tempest-VolumesSnapshotTestJSON-1294974655-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:36:39.380652 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-eca83b70-81b2-4aeb-83e5-fe25c5267c66 tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] Calling method '>' {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:36:39.383362 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-eca83b70-81b2-4aeb-83e5-fe25c5267c66 tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] [instance: bd57f4a8-0078-4dde-ac34-901a40bc7b8e] Fetching instance by UUID {{(pid=102148) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:36:39.404115 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-eca83b70-81b2-4aeb-83e5-fe25c5267c66 tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:36:39.405413 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-eca83b70-81b2-4aeb-83e5-fe25c5267c66 tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:36:39.419939 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-eca83b70-81b2-4aeb-83e5-fe25c5267c66 tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:36:39.420949 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-eca83b70-81b2-4aeb-83e5-fe25c5267c66 tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:36:39.646486 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-eca83b70-81b2-4aeb-83e5-fe25c5267c66 tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b823267a02a465192aadb5a1c5a3d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34b225f93234ca38c8d0c3d37ba0b8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:36:39.677857 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-eca83b70-81b2-4aeb-83e5-fe25c5267c66 tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] 10.222.0.18 "GET /compute/v2.1/servers/bd57f4a8-0078-4dde-ac34-901a40bc7b8e" status: 200 len: 1204 microversion: 2.1 time: 0.302269 Jun 24 16:36:39.691631 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 249/475] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:36:39 2022] GET /compute/v2.1/servers/bd57f4a8-0078-4dde-ac34-901a40bc7b8e => generated 1204 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 16:36:39.963497 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-80ab48b1-513a-495d-b184-c68cb6dd3d4e tempest-VolumesSnapshotTestJSON-1294974655 tempest-VolumesSnapshotTestJSON-1294974655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7b98bac241449c9a8b14307e4f7993a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0966981b5f4c3fa17c73c0c4b31779', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:36:39.976649 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-80ab48b1-513a-495d-b184-c68cb6dd3d4e tempest-VolumesSnapshotTestJSON-1294974655 tempest-VolumesSnapshotTestJSON-1294974655-project] 10.222.0.18 "GET /compute/v2.1/servers/6eb54c20-7da4-4c74-84fa-bc8e02d41498" status: 200 len: 1318 microversion: 2.1 time: 0.762700 Jun 24 16:36:39.977814 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 227/476] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:36:39 2022] GET /compute/v2.1/servers/6eb54c20-7da4-4c74-84fa-bc8e02d41498 => generated 1318 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 16:36:40.201225 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-c857b406-1a26-416c-b6a5-aa8fb7d651eb tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Action: 'create', calling method: .version_select at 0x7f1ae8d48e50>, body: {"keypair": {"name": "tempest-keypair-1212064982", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNwU9GptwEpTKYbvO5AVhzQlgXOrPoSxrLfA5gMqhsZDa69rns0ICv4cgkWMkJDe2nMLStr3ct14l+tn/Y+UhReh5WiRp6QWNmIoOymTstGMUXAzv1luGRKQCMi2VI6DWw=="}} {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 16:36:40.238668 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.quota [None req-c857b406-1a26-416c-b6a5-aa8fb7d651eb tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Getting quotas for project 065254ebe67545639644fcbc6bd9fc31. Resources: {'key_pairs'} {{(pid=102148) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jun 24 16:36:40.246518 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.quota [None req-c857b406-1a26-416c-b6a5-aa8fb7d651eb tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Getting quotas for user 7489b29cb3ef47d78dfd55794f338b27 and project 065254ebe67545639644fcbc6bd9fc31. Resources: {'key_pairs'} {{(pid=102148) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jun 24 16:36:40.290819 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-c857b406-1a26-416c-b6a5-aa8fb7d651eb tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.100659 Jun 24 16:36:40.292278 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 250/477] 10.222.0.18 () {62 vars in 1199 bytes} [Fri Jun 24 16:36:40 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 105 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jun 24 16:36:40.681478 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [req-63740189-b7e9-4e64-b88f-c4b5b5988e66 req-89c433a5-ad9a-447b-a219-11922b7e6440 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6eb54c20-7da4-4c74-84fa-bc8e02d41498", "tag": "d95976e1-d2cd-4d86-9f01-6e00d8d76035"}]} {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 16:36:40.684169 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 24 16:36:40.684169 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: warnings.warn(msg) Jun 24 16:36:40.720784 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-47229b9d-361e-4735-b8bb-8c8096149b6c tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] Calling method '>' {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:36:40.725854 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-47229b9d-361e-4735-b8bb-8c8096149b6c tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] [instance: bd57f4a8-0078-4dde-ac34-901a40bc7b8e] Fetching instance by UUID {{(pid=102148) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:36:40.738815 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [req-63740189-b7e9-4e64-b88f-c4b5b5988e66 req-89c433a5-ad9a-447b-a219-11922b7e6440 service nova] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:36:40.739628 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [req-63740189-b7e9-4e64-b88f-c4b5b5988e66 req-89c433a5-ad9a-447b-a219-11922b7e6440 service nova] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:36:40.765880 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-47229b9d-361e-4735-b8bb-8c8096149b6c tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:36:40.766866 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-47229b9d-361e-4735-b8bb-8c8096149b6c tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:36:40.768553 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-47229b9d-361e-4735-b8bb-8c8096149b6c tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:36:40.769443 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-47229b9d-361e-4735-b8bb-8c8096149b6c tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:36:40.777864 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.compute.server_external_events [req-63740189-b7e9-4e64-b88f-c4b5b5988e66 req-89c433a5-ad9a-447b-a219-11922b7e6440 service nova] Creating event network-changed:d95976e1-d2cd-4d86-9f01-6e00d8d76035 for instance 6eb54c20-7da4-4c74-84fa-bc8e02d41498 on hv-cinder-84718 Jun 24 16:36:40.784098 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [req-63740189-b7e9-4e64-b88f-c4b5b5988e66 req-89c433a5-ad9a-447b-a219-11922b7e6440 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.107898 Jun 24 16:36:40.785146 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 228/478] 10.222.0.18 () {64 vars in 1317 bytes} [Fri Jun 24 16:36:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 16:36:40.998721 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-2e7efb36-adc6-4a9c-b008-ad6123e9bd5a tempest-VolumesSnapshotTestJSON-1294974655 tempest-VolumesSnapshotTestJSON-1294974655-project] Calling method '>' {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:36:40.999790 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-2e7efb36-adc6-4a9c-b008-ad6123e9bd5a tempest-VolumesSnapshotTestJSON-1294974655 tempest-VolumesSnapshotTestJSON-1294974655-project] [instance: 6eb54c20-7da4-4c74-84fa-bc8e02d41498] Fetching instance by UUID {{(pid=102149) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:36:41.018264 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-2e7efb36-adc6-4a9c-b008-ad6123e9bd5a tempest-VolumesSnapshotTestJSON-1294974655 tempest-VolumesSnapshotTestJSON-1294974655-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:36:41.019183 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-2e7efb36-adc6-4a9c-b008-ad6123e9bd5a tempest-VolumesSnapshotTestJSON-1294974655 tempest-VolumesSnapshotTestJSON-1294974655-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:36:41.020933 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-2e7efb36-adc6-4a9c-b008-ad6123e9bd5a tempest-VolumesSnapshotTestJSON-1294974655 tempest-VolumesSnapshotTestJSON-1294974655-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:36:41.026334 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-2e7efb36-adc6-4a9c-b008-ad6123e9bd5a tempest-VolumesSnapshotTestJSON-1294974655 tempest-VolumesSnapshotTestJSON-1294974655-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:36:41.262629 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-47229b9d-361e-4735-b8bb-8c8096149b6c tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b823267a02a465192aadb5a1c5a3d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34b225f93234ca38c8d0c3d37ba0b8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:36:41.282585 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-47229b9d-361e-4735-b8bb-8c8096149b6c tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] 10.222.0.18 "GET /compute/v2.1/servers/bd57f4a8-0078-4dde-ac34-901a40bc7b8e" status: 200 len: 1260 microversion: 2.1 time: 0.580545 Jun 24 16:36:41.284184 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 251/479] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:36:40 2022] GET /compute/v2.1/servers/bd57f4a8-0078-4dde-ac34-901a40bc7b8e => generated 1260 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 16:36:41.590220 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-2e7efb36-adc6-4a9c-b008-ad6123e9bd5a tempest-VolumesSnapshotTestJSON-1294974655 tempest-VolumesSnapshotTestJSON-1294974655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7b98bac241449c9a8b14307e4f7993a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0966981b5f4c3fa17c73c0c4b31779', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:36:41.606174 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-2e7efb36-adc6-4a9c-b008-ad6123e9bd5a tempest-VolumesSnapshotTestJSON-1294974655 tempest-VolumesSnapshotTestJSON-1294974655-project] 10.222.0.18 "GET /compute/v2.1/servers/6eb54c20-7da4-4c74-84fa-bc8e02d41498" status: 200 len: 1318 microversion: 2.1 time: 0.610972 Jun 24 16:36:41.607057 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 229/480] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:36:40 2022] GET /compute/v2.1/servers/6eb54c20-7da4-4c74-84fa-bc8e02d41498 => generated 1318 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 16:36:42.314033 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-cef8f3c0-c40a-4ae1-8038-56ad07fe2ca4 tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] Calling method '>' {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:36:42.315066 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-cef8f3c0-c40a-4ae1-8038-56ad07fe2ca4 tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] [instance: bd57f4a8-0078-4dde-ac34-901a40bc7b8e] Fetching instance by UUID {{(pid=102148) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:36:42.334841 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-cef8f3c0-c40a-4ae1-8038-56ad07fe2ca4 tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:36:42.335876 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-cef8f3c0-c40a-4ae1-8038-56ad07fe2ca4 tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:36:42.337286 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-cef8f3c0-c40a-4ae1-8038-56ad07fe2ca4 tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:36:42.338248 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-cef8f3c0-c40a-4ae1-8038-56ad07fe2ca4 tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:36:42.412933 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [req-f96c8aa6-94e9-4b84-abe2-f031681259b3 req-6852a597-a466-4fd7-9ade-f3c84ca0728c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bd57f4a8-0078-4dde-ac34-901a40bc7b8e", "tag": "6d2412c6-1db3-4737-baaa-2744c29fbff8"}]} {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 16:36:42.416316 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 24 16:36:42.416316 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: warnings.warn(msg) Jun 24 16:36:42.439113 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [req-f96c8aa6-94e9-4b84-abe2-f031681259b3 req-6852a597-a466-4fd7-9ade-f3c84ca0728c service nova] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:36:42.442854 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [req-f96c8aa6-94e9-4b84-abe2-f031681259b3 req-6852a597-a466-4fd7-9ade-f3c84ca0728c service nova] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:36:42.490237 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.compute.server_external_events [req-f96c8aa6-94e9-4b84-abe2-f031681259b3 req-6852a597-a466-4fd7-9ade-f3c84ca0728c service nova] Creating event network-changed:6d2412c6-1db3-4737-baaa-2744c29fbff8 for instance bd57f4a8-0078-4dde-ac34-901a40bc7b8e on hv-cinder-84718 Jun 24 16:36:42.499527 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [req-f96c8aa6-94e9-4b84-abe2-f031681259b3 req-6852a597-a466-4fd7-9ade-f3c84ca0728c service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091689 Jun 24 16:36:42.502816 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 230/481] 10.222.0.18 () {64 vars in 1317 bytes} [Fri Jun 24 16:36:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 16:36:42.632297 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-5effd85f-f833-475f-9cc9-d6f997104a13 tempest-VolumesSnapshotTestJSON-1294974655 tempest-VolumesSnapshotTestJSON-1294974655-project] Calling method '>' {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:36:42.633000 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-5effd85f-f833-475f-9cc9-d6f997104a13 tempest-VolumesSnapshotTestJSON-1294974655 tempest-VolumesSnapshotTestJSON-1294974655-project] [instance: 6eb54c20-7da4-4c74-84fa-bc8e02d41498] Fetching instance by UUID {{(pid=102149) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:36:42.649999 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-5effd85f-f833-475f-9cc9-d6f997104a13 tempest-VolumesSnapshotTestJSON-1294974655 tempest-VolumesSnapshotTestJSON-1294974655-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:36:42.650738 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-5effd85f-f833-475f-9cc9-d6f997104a13 tempest-VolumesSnapshotTestJSON-1294974655 tempest-VolumesSnapshotTestJSON-1294974655-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:36:42.652008 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-5effd85f-f833-475f-9cc9-d6f997104a13 tempest-VolumesSnapshotTestJSON-1294974655 tempest-VolumesSnapshotTestJSON-1294974655-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:36:42.652681 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-5effd85f-f833-475f-9cc9-d6f997104a13 tempest-VolumesSnapshotTestJSON-1294974655 tempest-VolumesSnapshotTestJSON-1294974655-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:36:43.141642 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-cef8f3c0-c40a-4ae1-8038-56ad07fe2ca4 tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b823267a02a465192aadb5a1c5a3d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34b225f93234ca38c8d0c3d37ba0b8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:36:43.159204 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-cef8f3c0-c40a-4ae1-8038-56ad07fe2ca4 tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] 10.222.0.18 "GET /compute/v2.1/servers/bd57f4a8-0078-4dde-ac34-901a40bc7b8e" status: 200 len: 1260 microversion: 2.1 time: 0.853496 Jun 24 16:36:43.168600 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 252/482] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:36:42 2022] GET /compute/v2.1/servers/bd57f4a8-0078-4dde-ac34-901a40bc7b8e => generated 1260 bytes in 864 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 16:36:43.294053 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-5effd85f-f833-475f-9cc9-d6f997104a13 tempest-VolumesSnapshotTestJSON-1294974655 tempest-VolumesSnapshotTestJSON-1294974655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7b98bac241449c9a8b14307e4f7993a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0966981b5f4c3fa17c73c0c4b31779', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:36:43.306830 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-5effd85f-f833-475f-9cc9-d6f997104a13 tempest-VolumesSnapshotTestJSON-1294974655 tempest-VolumesSnapshotTestJSON-1294974655-project] 10.222.0.18 "GET /compute/v2.1/servers/6eb54c20-7da4-4c74-84fa-bc8e02d41498" status: 200 len: 1318 microversion: 2.1 time: 0.681421 Jun 24 16:36:43.307694 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 231/483] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:36:42 2022] GET /compute/v2.1/servers/6eb54c20-7da4-4c74-84fa-bc8e02d41498 => generated 1318 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 16:36:44.180232 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-3045438e-7f14-4324-a104-3f1d6f8efb34 tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] Calling method '>' {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:36:44.181130 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-3045438e-7f14-4324-a104-3f1d6f8efb34 tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] [instance: bd57f4a8-0078-4dde-ac34-901a40bc7b8e] Fetching instance by UUID {{(pid=102148) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:36:44.192238 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-3045438e-7f14-4324-a104-3f1d6f8efb34 tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:36:44.192681 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-3045438e-7f14-4324-a104-3f1d6f8efb34 tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:36:44.193498 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-3045438e-7f14-4324-a104-3f1d6f8efb34 tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:36:44.193931 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-3045438e-7f14-4324-a104-3f1d6f8efb34 tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:36:44.332564 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-35cfa3ba-1d23-453b-a998-aaaf2e5a3e20 tempest-VolumesSnapshotTestJSON-1294974655 tempest-VolumesSnapshotTestJSON-1294974655-project] Calling method '>' {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:36:44.334993 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-35cfa3ba-1d23-453b-a998-aaaf2e5a3e20 tempest-VolumesSnapshotTestJSON-1294974655 tempest-VolumesSnapshotTestJSON-1294974655-project] [instance: 6eb54c20-7da4-4c74-84fa-bc8e02d41498] Fetching instance by UUID {{(pid=102149) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:36:44.347257 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-35cfa3ba-1d23-453b-a998-aaaf2e5a3e20 tempest-VolumesSnapshotTestJSON-1294974655 tempest-VolumesSnapshotTestJSON-1294974655-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:36:44.348449 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-35cfa3ba-1d23-453b-a998-aaaf2e5a3e20 tempest-VolumesSnapshotTestJSON-1294974655 tempest-VolumesSnapshotTestJSON-1294974655-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:36:44.350642 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-35cfa3ba-1d23-453b-a998-aaaf2e5a3e20 tempest-VolumesSnapshotTestJSON-1294974655 tempest-VolumesSnapshotTestJSON-1294974655-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:36:44.351751 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-35cfa3ba-1d23-453b-a998-aaaf2e5a3e20 tempest-VolumesSnapshotTestJSON-1294974655 tempest-VolumesSnapshotTestJSON-1294974655-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:36:44.479195 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-3045438e-7f14-4324-a104-3f1d6f8efb34 tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b823267a02a465192aadb5a1c5a3d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34b225f93234ca38c8d0c3d37ba0b8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:36:44.495075 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-3045438e-7f14-4324-a104-3f1d6f8efb34 tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] 10.222.0.18 "GET /compute/v2.1/servers/bd57f4a8-0078-4dde-ac34-901a40bc7b8e" status: 200 len: 1260 microversion: 2.1 time: 0.321507 Jun 24 16:36:44.496075 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 253/484] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:36:44 2022] GET /compute/v2.1/servers/bd57f4a8-0078-4dde-ac34-901a40bc7b8e => generated 1260 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 16:36:44.655140 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-35cfa3ba-1d23-453b-a998-aaaf2e5a3e20 tempest-VolumesSnapshotTestJSON-1294974655 tempest-VolumesSnapshotTestJSON-1294974655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7b98bac241449c9a8b14307e4f7993a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0966981b5f4c3fa17c73c0c4b31779', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:36:44.666608 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-35cfa3ba-1d23-453b-a998-aaaf2e5a3e20 tempest-VolumesSnapshotTestJSON-1294974655 tempest-VolumesSnapshotTestJSON-1294974655-project] 10.222.0.18 "GET /compute/v2.1/servers/6eb54c20-7da4-4c74-84fa-bc8e02d41498" status: 200 len: 1318 microversion: 2.1 time: 0.340806 Jun 24 16:36:44.667230 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 232/485] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:36:44 2022] GET /compute/v2.1/servers/6eb54c20-7da4-4c74-84fa-bc8e02d41498 => generated 1318 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 16:36:44.835122 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-249e6ac3-cc68-458f-87fc-1fb98e4edc21 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-406732896", "imageRef": "113c9cfb-6cee-4018-9e63-66fae82b3851", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "de427c78-c07a-4b67-b16a-301f510eb5d6"}], "security_groups": [{"name": "tempest-securitygroup--1578651401"}], "key_name": "tempest-keypair-1212064982", "user_data": "}} {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 16:36:45.026636 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.network.neutron [None req-249e6ac3-cc68-458f-87fc-1fb98e4edc21 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] validate_networks() for [('de427c78-c07a-4b67-b16a-301f510eb5d6', None, None, None)] {{(pid=102148) validate_networks /opt/stack/nova/nova/network/neutron.py:2367}} Jun 24 16:36:45.513165 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-1daf4d33-fa4b-4d96-83f1-e5fbbd4eea5e tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] Calling method '>' {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:36:45.513995 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-1daf4d33-fa4b-4d96-83f1-e5fbbd4eea5e tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] [instance: bd57f4a8-0078-4dde-ac34-901a40bc7b8e] Fetching instance by UUID {{(pid=102149) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:36:45.523931 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-1daf4d33-fa4b-4d96-83f1-e5fbbd4eea5e tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:36:45.524593 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-1daf4d33-fa4b-4d96-83f1-e5fbbd4eea5e tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:36:45.525839 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-1daf4d33-fa4b-4d96-83f1-e5fbbd4eea5e tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:36:45.526533 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-1daf4d33-fa4b-4d96-83f1-e5fbbd4eea5e tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:36:45.717209 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.virt.hardware [None req-249e6ac3-cc68-458f-87fc-1fb98e4edc21 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Flavor limits 0:0:0 {{(pid=102148) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 24 16:36:45.718209 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.virt.hardware [None req-249e6ac3-cc68-458f-87fc-1fb98e4edc21 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Image limits 0:0:0 {{(pid=102148) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 24 16:36:45.718944 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.virt.hardware [None req-249e6ac3-cc68-458f-87fc-1fb98e4edc21 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Flavor pref 0:0:0 {{(pid=102148) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 24 16:36:45.719772 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.virt.hardware [None req-249e6ac3-cc68-458f-87fc-1fb98e4edc21 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Image pref 0:0:0 {{(pid=102148) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 24 16:36:45.720216 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.virt.hardware [None req-249e6ac3-cc68-458f-87fc-1fb98e4edc21 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=102148) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 24 16:36:45.730160 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-249e6ac3-cc68-458f-87fc-1fb98e4edc21 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:36:45.730766 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-249e6ac3-cc68-458f-87fc-1fb98e4edc21 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:36:45.732166 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-249e6ac3-cc68-458f-87fc-1fb98e4edc21 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:36:45.732688 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-249e6ac3-cc68-458f-87fc-1fb98e4edc21 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:36:45.762725 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.quota [None req-249e6ac3-cc68-458f-87fc-1fb98e4edc21 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Getting quotas for project 065254ebe67545639644fcbc6bd9fc31. Resources: {'ram', 'instances', 'cores'} {{(pid=102148) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jun 24 16:36:45.768647 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.quota [None req-249e6ac3-cc68-458f-87fc-1fb98e4edc21 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Getting quotas for user 7489b29cb3ef47d78dfd55794f338b27 and project 065254ebe67545639644fcbc6bd9fc31. Resources: {'ram', 'instances', 'cores'} {{(pid=102148) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jun 24 16:36:45.782830 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-249e6ac3-cc68-458f-87fc-1fb98e4edc21 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Going to run 1 instances... {{(pid=102148) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Jun 24 16:36:45.785003 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-249e6ac3-cc68-458f-87fc-1fb98e4edc21 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] [instance: 72af7667-a283-4567-894f-2bd233c01001] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='113c9cfb-6cee-4018-9e63-66fae82b3851',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=102148) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1684}} Jun 24 16:36:45.839462 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-249e6ac3-cc68-458f-87fc-1fb98e4edc21 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 1.010581 Jun 24 16:36:45.841257 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 254/486] 10.222.0.18 () {62 vars in 1187 bytes} [Fri Jun 24 16:36:44 2022] POST /compute/v2.1/servers => generated 402 bytes in 1013 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jun 24 16:36:45.849274 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-b787aafb-790f-4178-a322-97c05f6f8404 tempest-VolumesSnapshotTestJSON-1294974655 tempest-VolumesSnapshotTestJSON-1294974655-project] Calling method '>' {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:36:45.851435 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-b787aafb-790f-4178-a322-97c05f6f8404 tempest-VolumesSnapshotTestJSON-1294974655 tempest-VolumesSnapshotTestJSON-1294974655-project] [instance: 6eb54c20-7da4-4c74-84fa-bc8e02d41498] Fetching instance by UUID {{(pid=102148) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:36:45.865231 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-b787aafb-790f-4178-a322-97c05f6f8404 tempest-VolumesSnapshotTestJSON-1294974655 tempest-VolumesSnapshotTestJSON-1294974655-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:36:45.866002 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-b787aafb-790f-4178-a322-97c05f6f8404 tempest-VolumesSnapshotTestJSON-1294974655 tempest-VolumesSnapshotTestJSON-1294974655-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:36:45.867988 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-b787aafb-790f-4178-a322-97c05f6f8404 tempest-VolumesSnapshotTestJSON-1294974655 tempest-VolumesSnapshotTestJSON-1294974655-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:36:45.867988 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-b787aafb-790f-4178-a322-97c05f6f8404 tempest-VolumesSnapshotTestJSON-1294974655 tempest-VolumesSnapshotTestJSON-1294974655-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:36:45.909569 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-1daf4d33-fa4b-4d96-83f1-e5fbbd4eea5e tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b823267a02a465192aadb5a1c5a3d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34b225f93234ca38c8d0c3d37ba0b8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:36:45.919927 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-1daf4d33-fa4b-4d96-83f1-e5fbbd4eea5e tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] 10.222.0.18 "GET /compute/v2.1/servers/bd57f4a8-0078-4dde-ac34-901a40bc7b8e" status: 200 len: 1260 microversion: 2.1 time: 0.410940 Jun 24 16:36:45.920552 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 233/487] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:36:45 2022] GET /compute/v2.1/servers/bd57f4a8-0078-4dde-ac34-901a40bc7b8e => generated 1260 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 16:36:45.929103 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-cecb0a95-79ad-4d41-870b-431248236ece tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Calling method '>' {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:36:45.929897 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-cecb0a95-79ad-4d41-870b-431248236ece tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] [instance: 72af7667-a283-4567-894f-2bd233c01001] Fetching instance by UUID {{(pid=102149) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:36:46.068411 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-cecb0a95-79ad-4d41-870b-431248236ece tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7489b29cb3ef47d78dfd55794f338b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065254ebe67545639644fcbc6bd9fc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:36:46.076961 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-cecb0a95-79ad-4d41-870b-431248236ece tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7489b29cb3ef47d78dfd55794f338b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065254ebe67545639644fcbc6bd9fc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:36:46.078506 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-cecb0a95-79ad-4d41-870b-431248236ece tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7489b29cb3ef47d78dfd55794f338b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065254ebe67545639644fcbc6bd9fc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:36:46.080125 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-cecb0a95-79ad-4d41-870b-431248236ece tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] 10.222.0.18 "GET /compute/v2.1/servers/72af7667-a283-4567-894f-2bd233c01001" status: 200 len: 1281 microversion: 2.20 time: 0.158043 Jun 24 16:36:46.081030 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 234/488] 10.222.0.18 () {60 vars in 1276 bytes} [Fri Jun 24 16:36:45 2022] GET /compute/v2.1/servers/72af7667-a283-4567-894f-2bd233c01001 => generated 1281 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 16:36:46.201153 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-b787aafb-790f-4178-a322-97c05f6f8404 tempest-VolumesSnapshotTestJSON-1294974655 tempest-VolumesSnapshotTestJSON-1294974655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7b98bac241449c9a8b14307e4f7993a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0966981b5f4c3fa17c73c0c4b31779', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:36:46.210962 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-b787aafb-790f-4178-a322-97c05f6f8404 tempest-VolumesSnapshotTestJSON-1294974655 tempest-VolumesSnapshotTestJSON-1294974655-project] 10.222.0.18 "GET /compute/v2.1/servers/6eb54c20-7da4-4c74-84fa-bc8e02d41498" status: 200 len: 1318 microversion: 2.1 time: 0.368337 Jun 24 16:36:46.211909 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 255/489] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:36:45 2022] GET /compute/v2.1/servers/6eb54c20-7da4-4c74-84fa-bc8e02d41498 => generated 1318 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 16:36:46.948085 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-91a388ea-3877-4d07-85b5-636b61120ddf tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] Calling method '>' {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:36:46.948907 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-91a388ea-3877-4d07-85b5-636b61120ddf tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] [instance: bd57f4a8-0078-4dde-ac34-901a40bc7b8e] Fetching instance by UUID {{(pid=102149) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:36:46.963584 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-91a388ea-3877-4d07-85b5-636b61120ddf tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:36:46.964778 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-91a388ea-3877-4d07-85b5-636b61120ddf tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:36:46.966673 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-91a388ea-3877-4d07-85b5-636b61120ddf tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:36:46.967588 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-91a388ea-3877-4d07-85b5-636b61120ddf tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:36:47.110291 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-7a3af667-9814-4761-afce-4b3e7a6dc6a0 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Calling method '>' {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:36:47.111613 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-7a3af667-9814-4761-afce-4b3e7a6dc6a0 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] [instance: 72af7667-a283-4567-894f-2bd233c01001] Fetching instance by UUID {{(pid=102148) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:36:47.126541 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-7a3af667-9814-4761-afce-4b3e7a6dc6a0 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:36:47.127968 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-7a3af667-9814-4761-afce-4b3e7a6dc6a0 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:36:47.129882 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-7a3af667-9814-4761-afce-4b3e7a6dc6a0 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:36:47.130978 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-7a3af667-9814-4761-afce-4b3e7a6dc6a0 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:36:47.260382 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-91a388ea-3877-4d07-85b5-636b61120ddf tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b823267a02a465192aadb5a1c5a3d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34b225f93234ca38c8d0c3d37ba0b8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:36:47.270627 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-91a388ea-3877-4d07-85b5-636b61120ddf tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] 10.222.0.18 "GET /compute/v2.1/servers/bd57f4a8-0078-4dde-ac34-901a40bc7b8e" status: 200 len: 1260 microversion: 2.1 time: 0.326823 Jun 24 16:36:47.281503 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 235/490] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:36:46 2022] GET /compute/v2.1/servers/bd57f4a8-0078-4dde-ac34-901a40bc7b8e => generated 1260 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 16:36:47.301029 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-7f0a8f01-dc32-4b1f-b251-de5ddfcdf1fb tempest-VolumesSnapshotTestJSON-1294974655 tempest-VolumesSnapshotTestJSON-1294974655-project] Calling method '>' {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:36:47.312183 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-7f0a8f01-dc32-4b1f-b251-de5ddfcdf1fb tempest-VolumesSnapshotTestJSON-1294974655 tempest-VolumesSnapshotTestJSON-1294974655-project] [instance: 6eb54c20-7da4-4c74-84fa-bc8e02d41498] Fetching instance by UUID {{(pid=102149) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:36:47.343486 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-7f0a8f01-dc32-4b1f-b251-de5ddfcdf1fb tempest-VolumesSnapshotTestJSON-1294974655 tempest-VolumesSnapshotTestJSON-1294974655-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:36:47.345634 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-7f0a8f01-dc32-4b1f-b251-de5ddfcdf1fb tempest-VolumesSnapshotTestJSON-1294974655 tempest-VolumesSnapshotTestJSON-1294974655-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:36:47.348826 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-7f0a8f01-dc32-4b1f-b251-de5ddfcdf1fb tempest-VolumesSnapshotTestJSON-1294974655 tempest-VolumesSnapshotTestJSON-1294974655-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:36:47.351678 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-7f0a8f01-dc32-4b1f-b251-de5ddfcdf1fb tempest-VolumesSnapshotTestJSON-1294974655 tempest-VolumesSnapshotTestJSON-1294974655-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:36:47.359899 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-7a3af667-9814-4761-afce-4b3e7a6dc6a0 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7489b29cb3ef47d78dfd55794f338b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065254ebe67545639644fcbc6bd9fc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:36:47.382035 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-7a3af667-9814-4761-afce-4b3e7a6dc6a0 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7489b29cb3ef47d78dfd55794f338b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065254ebe67545639644fcbc6bd9fc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:36:47.385172 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-7a3af667-9814-4761-afce-4b3e7a6dc6a0 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7489b29cb3ef47d78dfd55794f338b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065254ebe67545639644fcbc6bd9fc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:36:47.387637 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-7a3af667-9814-4761-afce-4b3e7a6dc6a0 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] 10.222.0.18 "GET /compute/v2.1/servers/72af7667-a283-4567-894f-2bd233c01001" status: 200 len: 1341 microversion: 2.20 time: 0.285733 Jun 24 16:36:47.388960 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 256/491] 10.222.0.18 () {60 vars in 1276 bytes} [Fri Jun 24 16:36:47 2022] GET /compute/v2.1/servers/72af7667-a283-4567-894f-2bd233c01001 => generated 1341 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 16:36:47.695525 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-7f0a8f01-dc32-4b1f-b251-de5ddfcdf1fb tempest-VolumesSnapshotTestJSON-1294974655 tempest-VolumesSnapshotTestJSON-1294974655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7b98bac241449c9a8b14307e4f7993a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0966981b5f4c3fa17c73c0c4b31779', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:36:47.706815 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-7f0a8f01-dc32-4b1f-b251-de5ddfcdf1fb tempest-VolumesSnapshotTestJSON-1294974655 tempest-VolumesSnapshotTestJSON-1294974655-project] 10.222.0.18 "GET /compute/v2.1/servers/6eb54c20-7da4-4c74-84fa-bc8e02d41498" status: 200 len: 1318 microversion: 2.1 time: 0.423232 Jun 24 16:36:47.707488 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 236/492] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:36:47 2022] GET /compute/v2.1/servers/6eb54c20-7da4-4c74-84fa-bc8e02d41498 => generated 1318 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 16:36:48.288809 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-8a9415fe-eacc-4e08-8170-ed29b777cbe1 tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] Calling method '>' {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:36:48.289508 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-8a9415fe-eacc-4e08-8170-ed29b777cbe1 tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] [instance: bd57f4a8-0078-4dde-ac34-901a40bc7b8e] Fetching instance by UUID {{(pid=102148) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:36:48.297951 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-8a9415fe-eacc-4e08-8170-ed29b777cbe1 tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:36:48.298914 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-8a9415fe-eacc-4e08-8170-ed29b777cbe1 tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:36:48.300373 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-8a9415fe-eacc-4e08-8170-ed29b777cbe1 tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:36:48.301218 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-8a9415fe-eacc-4e08-8170-ed29b777cbe1 tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:36:48.421816 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-8a778cff-8eb6-44cf-ac86-ccc82e73d502 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Calling method '>' {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:36:48.423128 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-8a778cff-8eb6-44cf-ac86-ccc82e73d502 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] [instance: 72af7667-a283-4567-894f-2bd233c01001] Fetching instance by UUID {{(pid=102149) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:36:48.444127 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-8a778cff-8eb6-44cf-ac86-ccc82e73d502 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:36:48.458579 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-8a778cff-8eb6-44cf-ac86-ccc82e73d502 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:36:48.462451 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-8a778cff-8eb6-44cf-ac86-ccc82e73d502 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:36:48.472859 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-8a778cff-8eb6-44cf-ac86-ccc82e73d502 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:36:48.874490 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-8a9415fe-eacc-4e08-8170-ed29b777cbe1 tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b823267a02a465192aadb5a1c5a3d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34b225f93234ca38c8d0c3d37ba0b8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:36:48.879097 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-8a778cff-8eb6-44cf-ac86-ccc82e73d502 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7489b29cb3ef47d78dfd55794f338b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065254ebe67545639644fcbc6bd9fc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:36:48.889509 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-8a9415fe-eacc-4e08-8170-ed29b777cbe1 tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] 10.222.0.18 "GET /compute/v2.1/servers/bd57f4a8-0078-4dde-ac34-901a40bc7b8e" status: 200 len: 1260 microversion: 2.1 time: 0.605040 Jun 24 16:36:48.890347 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 257/493] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:36:48 2022] GET /compute/v2.1/servers/bd57f4a8-0078-4dde-ac34-901a40bc7b8e => generated 1260 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 16:36:48.890884 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-8a778cff-8eb6-44cf-ac86-ccc82e73d502 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7489b29cb3ef47d78dfd55794f338b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065254ebe67545639644fcbc6bd9fc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:36:48.894205 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-8a778cff-8eb6-44cf-ac86-ccc82e73d502 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7489b29cb3ef47d78dfd55794f338b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065254ebe67545639644fcbc6bd9fc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:36:48.895798 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [req-75975206-fdc5-43cc-8f65-4adbf78a5073 req-a1eea7e1-6cbf-4bdd-b6ac-48acd2a4a40b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6eb54c20-7da4-4c74-84fa-bc8e02d41498", "name": "network-vif-plugged", "status": "completed", "tag": "d95976e1-d2cd-4d86-9f01-6e00d8d76035"}]} {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 16:36:48.897659 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 24 16:36:48.897659 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: warnings.warn(msg) Jun 24 16:36:48.898525 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-8a778cff-8eb6-44cf-ac86-ccc82e73d502 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] 10.222.0.18 "GET /compute/v2.1/servers/72af7667-a283-4567-894f-2bd233c01001" status: 200 len: 1407 microversion: 2.20 time: 0.482879 Jun 24 16:36:48.903862 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 237/494] 10.222.0.18 () {60 vars in 1276 bytes} [Fri Jun 24 16:36:48 2022] GET /compute/v2.1/servers/72af7667-a283-4567-894f-2bd233c01001 => generated 1407 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 16:36:48.911406 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [req-75975206-fdc5-43cc-8f65-4adbf78a5073 req-a1eea7e1-6cbf-4bdd-b6ac-48acd2a4a40b service nova] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:36:48.912169 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [req-75975206-fdc5-43cc-8f65-4adbf78a5073 req-a1eea7e1-6cbf-4bdd-b6ac-48acd2a4a40b service nova] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:36:48.913120 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-4307bb44-e7ee-44ac-9255-f18d122edb08 tempest-VolumesSnapshotTestJSON-1294974655 tempest-VolumesSnapshotTestJSON-1294974655-project] Calling method '>' {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:36:48.914291 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-4307bb44-e7ee-44ac-9255-f18d122edb08 tempest-VolumesSnapshotTestJSON-1294974655 tempest-VolumesSnapshotTestJSON-1294974655-project] [instance: 6eb54c20-7da4-4c74-84fa-bc8e02d41498] Fetching instance by UUID {{(pid=102149) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:36:48.932767 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.compute.server_external_events [req-75975206-fdc5-43cc-8f65-4adbf78a5073 req-a1eea7e1-6cbf-4bdd-b6ac-48acd2a4a40b service nova] Creating event network-vif-plugged:d95976e1-d2cd-4d86-9f01-6e00d8d76035 for instance 6eb54c20-7da4-4c74-84fa-bc8e02d41498 on hv-cinder-84718 Jun 24 16:36:48.933149 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-4307bb44-e7ee-44ac-9255-f18d122edb08 tempest-VolumesSnapshotTestJSON-1294974655 tempest-VolumesSnapshotTestJSON-1294974655-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:36:48.934052 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-4307bb44-e7ee-44ac-9255-f18d122edb08 tempest-VolumesSnapshotTestJSON-1294974655 tempest-VolumesSnapshotTestJSON-1294974655-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:36:48.935422 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-4307bb44-e7ee-44ac-9255-f18d122edb08 tempest-VolumesSnapshotTestJSON-1294974655 tempest-VolumesSnapshotTestJSON-1294974655-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:36:48.936457 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-4307bb44-e7ee-44ac-9255-f18d122edb08 tempest-VolumesSnapshotTestJSON-1294974655 tempest-VolumesSnapshotTestJSON-1294974655-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:36:48.940517 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [req-75975206-fdc5-43cc-8f65-4adbf78a5073 req-a1eea7e1-6cbf-4bdd-b6ac-48acd2a4a40b service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048427 Jun 24 16:36:48.941905 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 258/495] 10.222.0.18 () {64 vars in 1317 bytes} [Fri Jun 24 16:36:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 16:36:49.294180 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-4307bb44-e7ee-44ac-9255-f18d122edb08 tempest-VolumesSnapshotTestJSON-1294974655 tempest-VolumesSnapshotTestJSON-1294974655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7b98bac241449c9a8b14307e4f7993a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0966981b5f4c3fa17c73c0c4b31779', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:36:49.303747 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-4307bb44-e7ee-44ac-9255-f18d122edb08 tempest-VolumesSnapshotTestJSON-1294974655 tempest-VolumesSnapshotTestJSON-1294974655-project] 10.222.0.18 "GET /compute/v2.1/servers/6eb54c20-7da4-4c74-84fa-bc8e02d41498" status: 200 len: 1318 microversion: 2.1 time: 0.398436 Jun 24 16:36:49.304994 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 238/496] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:36:48 2022] GET /compute/v2.1/servers/6eb54c20-7da4-4c74-84fa-bc8e02d41498 => generated 1318 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 16:36:49.827090 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [req-49161cf4-614c-4fd4-90b5-a9f1c7e01c9f req-e1d2ac64-d15d-4d13-8b50-0abe381a75cd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "72af7667-a283-4567-894f-2bd233c01001", "tag": "87b332d5-d83a-40ca-bb6b-503444dbbfbe"}]} {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 16:36:49.829074 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 24 16:36:49.829074 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: warnings.warn(msg) Jun 24 16:36:49.839419 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [req-49161cf4-614c-4fd4-90b5-a9f1c7e01c9f req-e1d2ac64-d15d-4d13-8b50-0abe381a75cd service nova] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:36:49.840720 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [req-49161cf4-614c-4fd4-90b5-a9f1c7e01c9f req-e1d2ac64-d15d-4d13-8b50-0abe381a75cd service nova] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:36:49.870141 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.compute.server_external_events [req-49161cf4-614c-4fd4-90b5-a9f1c7e01c9f req-e1d2ac64-d15d-4d13-8b50-0abe381a75cd service nova] Creating event network-changed:87b332d5-d83a-40ca-bb6b-503444dbbfbe for instance 72af7667-a283-4567-894f-2bd233c01001 on hv-cinder-84718 Jun 24 16:36:49.876735 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [req-49161cf4-614c-4fd4-90b5-a9f1c7e01c9f req-e1d2ac64-d15d-4d13-8b50-0abe381a75cd service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054481 Jun 24 16:36:49.877349 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 259/497] 10.222.0.18 () {64 vars in 1317 bytes} [Fri Jun 24 16:36:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 16:36:49.912813 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-55a12c99-5c76-48da-b05c-d588e55074d3 tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] Calling method '>' {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:36:49.914001 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-55a12c99-5c76-48da-b05c-d588e55074d3 tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] [instance: bd57f4a8-0078-4dde-ac34-901a40bc7b8e] Fetching instance by UUID {{(pid=102149) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:36:49.927744 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-2c6a29b3-f57d-462b-a8ee-310ade95942d tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Calling method '>' {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:36:49.929573 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-2c6a29b3-f57d-462b-a8ee-310ade95942d tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] [instance: 72af7667-a283-4567-894f-2bd233c01001] Fetching instance by UUID {{(pid=102148) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:36:49.943355 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-55a12c99-5c76-48da-b05c-d588e55074d3 tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:36:49.944535 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-55a12c99-5c76-48da-b05c-d588e55074d3 tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:36:49.949039 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-55a12c99-5c76-48da-b05c-d588e55074d3 tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:36:49.949287 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-2c6a29b3-f57d-462b-a8ee-310ade95942d tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:36:49.949502 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-55a12c99-5c76-48da-b05c-d588e55074d3 tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:36:49.949686 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-2c6a29b3-f57d-462b-a8ee-310ade95942d tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:36:49.950610 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-2c6a29b3-f57d-462b-a8ee-310ade95942d tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:36:49.951397 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-2c6a29b3-f57d-462b-a8ee-310ade95942d tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:36:50.317034 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-2c6a29b3-f57d-462b-a8ee-310ade95942d tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7489b29cb3ef47d78dfd55794f338b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065254ebe67545639644fcbc6bd9fc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:36:50.331115 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-2c6a29b3-f57d-462b-a8ee-310ade95942d tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7489b29cb3ef47d78dfd55794f338b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065254ebe67545639644fcbc6bd9fc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:36:50.331853 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-55a12c99-5c76-48da-b05c-d588e55074d3 tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b823267a02a465192aadb5a1c5a3d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34b225f93234ca38c8d0c3d37ba0b8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:36:50.333147 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-2c6a29b3-f57d-462b-a8ee-310ade95942d tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7489b29cb3ef47d78dfd55794f338b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065254ebe67545639644fcbc6bd9fc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:36:50.335238 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-2c6a29b3-f57d-462b-a8ee-310ade95942d tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] 10.222.0.18 "GET /compute/v2.1/servers/72af7667-a283-4567-894f-2bd233c01001" status: 200 len: 1407 microversion: 2.20 time: 0.415816 Jun 24 16:36:50.351760 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 260/498] 10.222.0.18 () {60 vars in 1276 bytes} [Fri Jun 24 16:36:49 2022] GET /compute/v2.1/servers/72af7667-a283-4567-894f-2bd233c01001 => generated 1407 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 16:36:50.354339 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-55a12c99-5c76-48da-b05c-d588e55074d3 tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] 10.222.0.18 "GET /compute/v2.1/servers/bd57f4a8-0078-4dde-ac34-901a40bc7b8e" status: 200 len: 1260 microversion: 2.1 time: 0.449550 Jun 24 16:36:50.355573 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 239/499] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:36:49 2022] GET /compute/v2.1/servers/bd57f4a8-0078-4dde-ac34-901a40bc7b8e => generated 1260 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 16:36:50.357991 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-cdab7d2d-68c6-49dc-afd3-07d07384212c tempest-VolumesSnapshotTestJSON-1294974655 tempest-VolumesSnapshotTestJSON-1294974655-project] Calling method '>' {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:36:50.358615 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-cdab7d2d-68c6-49dc-afd3-07d07384212c tempest-VolumesSnapshotTestJSON-1294974655 tempest-VolumesSnapshotTestJSON-1294974655-project] [instance: 6eb54c20-7da4-4c74-84fa-bc8e02d41498] Fetching instance by UUID {{(pid=102148) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:36:50.366498 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-cdab7d2d-68c6-49dc-afd3-07d07384212c tempest-VolumesSnapshotTestJSON-1294974655 tempest-VolumesSnapshotTestJSON-1294974655-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:36:50.366979 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-cdab7d2d-68c6-49dc-afd3-07d07384212c tempest-VolumesSnapshotTestJSON-1294974655 tempest-VolumesSnapshotTestJSON-1294974655-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:36:50.367769 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-cdab7d2d-68c6-49dc-afd3-07d07384212c tempest-VolumesSnapshotTestJSON-1294974655 tempest-VolumesSnapshotTestJSON-1294974655-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:36:50.368205 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-cdab7d2d-68c6-49dc-afd3-07d07384212c tempest-VolumesSnapshotTestJSON-1294974655 tempest-VolumesSnapshotTestJSON-1294974655-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:36:50.622553 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-cdab7d2d-68c6-49dc-afd3-07d07384212c tempest-VolumesSnapshotTestJSON-1294974655 tempest-VolumesSnapshotTestJSON-1294974655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7b98bac241449c9a8b14307e4f7993a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0966981b5f4c3fa17c73c0c4b31779', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:36:50.637824 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-cdab7d2d-68c6-49dc-afd3-07d07384212c tempest-VolumesSnapshotTestJSON-1294974655 tempest-VolumesSnapshotTestJSON-1294974655-project] 10.222.0.18 "GET /compute/v2.1/servers/6eb54c20-7da4-4c74-84fa-bc8e02d41498" status: 200 len: 1318 microversion: 2.1 time: 0.284800 Jun 24 16:36:50.638412 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 261/500] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:36:50 2022] GET /compute/v2.1/servers/6eb54c20-7da4-4c74-84fa-bc8e02d41498 => generated 1318 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 16:36:51.363201 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-e112db83-8ab7-4121-8750-8b5df8d39a53 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Calling method '>' {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:36:51.364477 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-e112db83-8ab7-4121-8750-8b5df8d39a53 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] [instance: 72af7667-a283-4567-894f-2bd233c01001] Fetching instance by UUID {{(pid=102149) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:36:51.376149 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-60de1882-5e97-4120-9a26-503fc71f886f tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] Calling method '>' {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:36:51.378218 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-60de1882-5e97-4120-9a26-503fc71f886f tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] [instance: bd57f4a8-0078-4dde-ac34-901a40bc7b8e] Fetching instance by UUID {{(pid=102148) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:36:51.383083 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-e112db83-8ab7-4121-8750-8b5df8d39a53 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:36:51.383083 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-e112db83-8ab7-4121-8750-8b5df8d39a53 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:36:51.383083 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-e112db83-8ab7-4121-8750-8b5df8d39a53 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:36:51.383459 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-e112db83-8ab7-4121-8750-8b5df8d39a53 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:36:51.386567 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-60de1882-5e97-4120-9a26-503fc71f886f tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:36:51.387350 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-60de1882-5e97-4120-9a26-503fc71f886f tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:36:51.388292 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-60de1882-5e97-4120-9a26-503fc71f886f tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:36:51.389140 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-60de1882-5e97-4120-9a26-503fc71f886f tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:36:51.783848 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-60de1882-5e97-4120-9a26-503fc71f886f tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b823267a02a465192aadb5a1c5a3d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34b225f93234ca38c8d0c3d37ba0b8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:36:51.785595 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-e112db83-8ab7-4121-8750-8b5df8d39a53 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7489b29cb3ef47d78dfd55794f338b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065254ebe67545639644fcbc6bd9fc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:36:51.795452 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-e112db83-8ab7-4121-8750-8b5df8d39a53 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7489b29cb3ef47d78dfd55794f338b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065254ebe67545639644fcbc6bd9fc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:36:51.797021 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-e112db83-8ab7-4121-8750-8b5df8d39a53 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7489b29cb3ef47d78dfd55794f338b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065254ebe67545639644fcbc6bd9fc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:36:51.798114 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-e112db83-8ab7-4121-8750-8b5df8d39a53 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] 10.222.0.18 "GET /compute/v2.1/servers/72af7667-a283-4567-894f-2bd233c01001" status: 200 len: 1407 microversion: 2.20 time: 0.441441 Jun 24 16:36:51.798280 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-60de1882-5e97-4120-9a26-503fc71f886f tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] 10.222.0.18 "GET /compute/v2.1/servers/bd57f4a8-0078-4dde-ac34-901a40bc7b8e" status: 200 len: 1260 microversion: 2.1 time: 0.425859 Jun 24 16:36:51.810848 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 240/501] 10.222.0.18 () {60 vars in 1276 bytes} [Fri Jun 24 16:36:51 2022] GET /compute/v2.1/servers/72af7667-a283-4567-894f-2bd233c01001 => generated 1407 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 16:36:51.811168 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 262/502] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:36:51 2022] GET /compute/v2.1/servers/bd57f4a8-0078-4dde-ac34-901a40bc7b8e => generated 1260 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 16:36:51.811367 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-8e5ec3a1-dee4-40b0-97d9-f1f4ae81a20f tempest-VolumesSnapshotTestJSON-1294974655 tempest-VolumesSnapshotTestJSON-1294974655-project] Calling method '>' {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:36:51.811367 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-8e5ec3a1-dee4-40b0-97d9-f1f4ae81a20f tempest-VolumesSnapshotTestJSON-1294974655 tempest-VolumesSnapshotTestJSON-1294974655-project] [instance: 6eb54c20-7da4-4c74-84fa-bc8e02d41498] Fetching instance by UUID {{(pid=102149) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:36:51.817468 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-8e5ec3a1-dee4-40b0-97d9-f1f4ae81a20f tempest-VolumesSnapshotTestJSON-1294974655 tempest-VolumesSnapshotTestJSON-1294974655-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:36:51.818294 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-8e5ec3a1-dee4-40b0-97d9-f1f4ae81a20f tempest-VolumesSnapshotTestJSON-1294974655 tempest-VolumesSnapshotTestJSON-1294974655-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:36:51.820045 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-8e5ec3a1-dee4-40b0-97d9-f1f4ae81a20f tempest-VolumesSnapshotTestJSON-1294974655 tempest-VolumesSnapshotTestJSON-1294974655-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:36:51.820696 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-8e5ec3a1-dee4-40b0-97d9-f1f4ae81a20f tempest-VolumesSnapshotTestJSON-1294974655 tempest-VolumesSnapshotTestJSON-1294974655-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:36:52.093122 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-8e5ec3a1-dee4-40b0-97d9-f1f4ae81a20f tempest-VolumesSnapshotTestJSON-1294974655 tempest-VolumesSnapshotTestJSON-1294974655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7b98bac241449c9a8b14307e4f7993a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0966981b5f4c3fa17c73c0c4b31779', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:36:52.105766 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-8e5ec3a1-dee4-40b0-97d9-f1f4ae81a20f tempest-VolumesSnapshotTestJSON-1294974655 tempest-VolumesSnapshotTestJSON-1294974655-project] 10.222.0.18 "GET /compute/v2.1/servers/6eb54c20-7da4-4c74-84fa-bc8e02d41498" status: 200 len: 1507 microversion: 2.1 time: 0.304960 Jun 24 16:36:52.106792 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 241/503] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:36:51 2022] GET /compute/v2.1/servers/6eb54c20-7da4-4c74-84fa-bc8e02d41498 => generated 1507 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 16:36:52.123135 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-682267b8-fc2f-4332-a92e-7a94ea9fc619 tempest-VolumesSnapshotTestJSON-1294974655 tempest-VolumesSnapshotTestJSON-1294974655-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "24baca46-6bec-4df4-aced-77062af1c687", "device": "/dev/sdb"}} {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 16:36:52.124774 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-682267b8-fc2f-4332-a92e-7a94ea9fc619 tempest-VolumesSnapshotTestJSON-1294974655 tempest-VolumesSnapshotTestJSON-1294974655-project] [instance: 6eb54c20-7da4-4c74-84fa-bc8e02d41498] Fetching instance by UUID {{(pid=102148) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:36:52.132686 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-682267b8-fc2f-4332-a92e-7a94ea9fc619 tempest-VolumesSnapshotTestJSON-1294974655 tempest-VolumesSnapshotTestJSON-1294974655-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:36:52.133136 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-682267b8-fc2f-4332-a92e-7a94ea9fc619 tempest-VolumesSnapshotTestJSON-1294974655 tempest-VolumesSnapshotTestJSON-1294974655-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:36:52.134064 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-682267b8-fc2f-4332-a92e-7a94ea9fc619 tempest-VolumesSnapshotTestJSON-1294974655 tempest-VolumesSnapshotTestJSON-1294974655-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:36:52.134492 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-682267b8-fc2f-4332-a92e-7a94ea9fc619 tempest-VolumesSnapshotTestJSON-1294974655 tempest-VolumesSnapshotTestJSON-1294974655-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:36:52.640527 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-682267b8-fc2f-4332-a92e-7a94ea9fc619 tempest-VolumesSnapshotTestJSON-1294974655 tempest-VolumesSnapshotTestJSON-1294974655-project] 10.222.0.18 "POST /compute/v2.1/servers/6eb54c20-7da4-4c74-84fa-bc8e02d41498/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.521110 Jun 24 16:36:52.641528 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 263/504] 10.222.0.18 () {60 vars in 1322 bytes} [Fri Jun 24 16:36:52 2022] POST /compute/v2.1/servers/6eb54c20-7da4-4c74-84fa-bc8e02d41498/os-volume_attachments => generated 194 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 16:36:52.827426 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-3b0f94dd-6bbb-4031-a0b4-8a28ae64cf94 tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] Calling method '>' {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:36:52.828569 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-3b0f94dd-6bbb-4031-a0b4-8a28ae64cf94 tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] [instance: bd57f4a8-0078-4dde-ac34-901a40bc7b8e] Fetching instance by UUID {{(pid=102149) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:36:52.830822 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-b71fd754-1a0d-4a53-9738-e715ee1f9b34 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Calling method '>' {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:36:52.832321 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-b71fd754-1a0d-4a53-9738-e715ee1f9b34 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] [instance: 72af7667-a283-4567-894f-2bd233c01001] Fetching instance by UUID {{(pid=102148) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:36:52.840732 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-3b0f94dd-6bbb-4031-a0b4-8a28ae64cf94 tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:36:52.841390 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-3b0f94dd-6bbb-4031-a0b4-8a28ae64cf94 tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:36:52.842412 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-3b0f94dd-6bbb-4031-a0b4-8a28ae64cf94 tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:36:52.842884 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-3b0f94dd-6bbb-4031-a0b4-8a28ae64cf94 tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:36:52.848208 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-b71fd754-1a0d-4a53-9738-e715ee1f9b34 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:36:52.849128 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-b71fd754-1a0d-4a53-9738-e715ee1f9b34 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:36:52.850603 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-b71fd754-1a0d-4a53-9738-e715ee1f9b34 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:36:52.851537 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-b71fd754-1a0d-4a53-9738-e715ee1f9b34 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:36:53.310828 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-3b0f94dd-6bbb-4031-a0b4-8a28ae64cf94 tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b823267a02a465192aadb5a1c5a3d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34b225f93234ca38c8d0c3d37ba0b8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:36:53.323993 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-3b0f94dd-6bbb-4031-a0b4-8a28ae64cf94 tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] 10.222.0.18 "GET /compute/v2.1/servers/bd57f4a8-0078-4dde-ac34-901a40bc7b8e" status: 200 len: 1260 microversion: 2.1 time: 0.503947 Jun 24 16:36:53.324927 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 242/505] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:36:52 2022] GET /compute/v2.1/servers/bd57f4a8-0078-4dde-ac34-901a40bc7b8e => generated 1260 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 16:36:53.336548 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-b71fd754-1a0d-4a53-9738-e715ee1f9b34 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7489b29cb3ef47d78dfd55794f338b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065254ebe67545639644fcbc6bd9fc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:36:53.344695 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-b71fd754-1a0d-4a53-9738-e715ee1f9b34 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7489b29cb3ef47d78dfd55794f338b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065254ebe67545639644fcbc6bd9fc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:36:53.348251 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-b71fd754-1a0d-4a53-9738-e715ee1f9b34 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7489b29cb3ef47d78dfd55794f338b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065254ebe67545639644fcbc6bd9fc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:36:53.350077 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-b71fd754-1a0d-4a53-9738-e715ee1f9b34 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] 10.222.0.18 "GET /compute/v2.1/servers/72af7667-a283-4567-894f-2bd233c01001" status: 200 len: 1407 microversion: 2.20 time: 0.529288 Jun 24 16:36:53.351039 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 264/506] 10.222.0.18 () {60 vars in 1276 bytes} [Fri Jun 24 16:36:52 2022] GET /compute/v2.1/servers/72af7667-a283-4567-894f-2bd233c01001 => generated 1407 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 16:36:54.346123 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-8bbc10da-d1d6-4bcf-bcd2-9947cdf71923 tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] Calling method '>' {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:36:54.347849 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-8bbc10da-d1d6-4bcf-bcd2-9947cdf71923 tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] [instance: bd57f4a8-0078-4dde-ac34-901a40bc7b8e] Fetching instance by UUID {{(pid=102149) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:36:54.360618 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-8bbc10da-d1d6-4bcf-bcd2-9947cdf71923 tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:36:54.361783 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-8bbc10da-d1d6-4bcf-bcd2-9947cdf71923 tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:36:54.363559 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-8bbc10da-d1d6-4bcf-bcd2-9947cdf71923 tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:36:54.364253 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-8bbc10da-d1d6-4bcf-bcd2-9947cdf71923 tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:36:54.382671 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-c714fc0b-3556-4eaf-bb70-c0949c40cb43 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Calling method '>' {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:36:54.383518 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-c714fc0b-3556-4eaf-bb70-c0949c40cb43 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] [instance: 72af7667-a283-4567-894f-2bd233c01001] Fetching instance by UUID {{(pid=102148) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:36:54.394771 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-c714fc0b-3556-4eaf-bb70-c0949c40cb43 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:36:54.395793 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-c714fc0b-3556-4eaf-bb70-c0949c40cb43 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:36:54.398100 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-c714fc0b-3556-4eaf-bb70-c0949c40cb43 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:36:54.398620 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-c714fc0b-3556-4eaf-bb70-c0949c40cb43 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:36:54.808019 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-8bbc10da-d1d6-4bcf-bcd2-9947cdf71923 tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b823267a02a465192aadb5a1c5a3d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34b225f93234ca38c8d0c3d37ba0b8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:36:54.819170 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-c714fc0b-3556-4eaf-bb70-c0949c40cb43 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7489b29cb3ef47d78dfd55794f338b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065254ebe67545639644fcbc6bd9fc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:36:54.820824 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-8bbc10da-d1d6-4bcf-bcd2-9947cdf71923 tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] 10.222.0.18 "GET /compute/v2.1/servers/bd57f4a8-0078-4dde-ac34-901a40bc7b8e" status: 200 len: 1260 microversion: 2.1 time: 0.479965 Jun 24 16:36:54.833432 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 243/507] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:36:54 2022] GET /compute/v2.1/servers/bd57f4a8-0078-4dde-ac34-901a40bc7b8e => generated 1260 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 16:36:54.833432 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [req-6bb9ed0d-c5c3-480e-9d5b-5ca5097f45a3 req-8da47de0-e79e-464a-843c-25ac66dc8234 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bd57f4a8-0078-4dde-ac34-901a40bc7b8e", "name": "network-vif-plugged", "status": "completed", "tag": "6d2412c6-1db3-4737-baaa-2744c29fbff8"}]} {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 16:36:54.833432 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 24 16:36:54.833432 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: warnings.warn(msg) Jun 24 16:36:54.843037 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-c714fc0b-3556-4eaf-bb70-c0949c40cb43 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7489b29cb3ef47d78dfd55794f338b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065254ebe67545639644fcbc6bd9fc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:36:54.844230 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [req-6bb9ed0d-c5c3-480e-9d5b-5ca5097f45a3 req-8da47de0-e79e-464a-843c-25ac66dc8234 service nova] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:36:54.844894 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [req-6bb9ed0d-c5c3-480e-9d5b-5ca5097f45a3 req-8da47de0-e79e-464a-843c-25ac66dc8234 service nova] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:36:54.845947 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-c714fc0b-3556-4eaf-bb70-c0949c40cb43 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7489b29cb3ef47d78dfd55794f338b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065254ebe67545639644fcbc6bd9fc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:36:54.851145 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-c714fc0b-3556-4eaf-bb70-c0949c40cb43 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] 10.222.0.18 "GET /compute/v2.1/servers/72af7667-a283-4567-894f-2bd233c01001" status: 200 len: 1407 microversion: 2.20 time: 0.475919 Jun 24 16:36:54.852038 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 265/508] 10.222.0.18 () {60 vars in 1276 bytes} [Fri Jun 24 16:36:54 2022] GET /compute/v2.1/servers/72af7667-a283-4567-894f-2bd233c01001 => generated 1407 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 16:36:54.874078 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.compute.server_external_events [req-6bb9ed0d-c5c3-480e-9d5b-5ca5097f45a3 req-8da47de0-e79e-464a-843c-25ac66dc8234 service nova] Creating event network-vif-plugged:6d2412c6-1db3-4737-baaa-2744c29fbff8 for instance bd57f4a8-0078-4dde-ac34-901a40bc7b8e on hv-cinder-84718 Jun 24 16:36:54.882792 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [req-6bb9ed0d-c5c3-480e-9d5b-5ca5097f45a3 req-8da47de0-e79e-464a-843c-25ac66dc8234 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058481 Jun 24 16:36:54.883875 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 244/509] 10.222.0.18 () {64 vars in 1317 bytes} [Fri Jun 24 16:36:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 16:36:55.848206 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-3022bb76-012a-4c53-8971-2c63427dd46f tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] Calling method '>' {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:36:55.848915 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-3022bb76-012a-4c53-8971-2c63427dd46f tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] [instance: bd57f4a8-0078-4dde-ac34-901a40bc7b8e] Fetching instance by UUID {{(pid=102148) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:36:55.859488 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-3022bb76-012a-4c53-8971-2c63427dd46f tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:36:55.862028 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-3022bb76-012a-4c53-8971-2c63427dd46f tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:36:55.862028 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-3022bb76-012a-4c53-8971-2c63427dd46f tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:36:55.862560 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-3022bb76-012a-4c53-8971-2c63427dd46f tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:36:55.880378 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-db2788e3-c9b5-4c83-b3d6-cc84a90b957b tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Calling method '>' {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:36:55.881948 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-db2788e3-c9b5-4c83-b3d6-cc84a90b957b tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] [instance: 72af7667-a283-4567-894f-2bd233c01001] Fetching instance by UUID {{(pid=102149) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:36:55.895946 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-db2788e3-c9b5-4c83-b3d6-cc84a90b957b tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:36:55.897261 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-db2788e3-c9b5-4c83-b3d6-cc84a90b957b tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:36:55.898597 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-db2788e3-c9b5-4c83-b3d6-cc84a90b957b tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:36:55.899418 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-db2788e3-c9b5-4c83-b3d6-cc84a90b957b tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:36:56.250217 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-3022bb76-012a-4c53-8971-2c63427dd46f tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b823267a02a465192aadb5a1c5a3d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34b225f93234ca38c8d0c3d37ba0b8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:36:56.257119 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-db2788e3-c9b5-4c83-b3d6-cc84a90b957b tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7489b29cb3ef47d78dfd55794f338b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065254ebe67545639644fcbc6bd9fc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:36:56.265476 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-3022bb76-012a-4c53-8971-2c63427dd46f tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] 10.222.0.18 "GET /compute/v2.1/servers/bd57f4a8-0078-4dde-ac34-901a40bc7b8e" status: 200 len: 1260 microversion: 2.1 time: 0.420498 Jun 24 16:36:56.266613 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 266/510] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:36:55 2022] GET /compute/v2.1/servers/bd57f4a8-0078-4dde-ac34-901a40bc7b8e => generated 1260 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 16:36:56.274717 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-db2788e3-c9b5-4c83-b3d6-cc84a90b957b tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7489b29cb3ef47d78dfd55794f338b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065254ebe67545639644fcbc6bd9fc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:36:56.277281 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-db2788e3-c9b5-4c83-b3d6-cc84a90b957b tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7489b29cb3ef47d78dfd55794f338b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065254ebe67545639644fcbc6bd9fc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:36:56.279234 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-db2788e3-c9b5-4c83-b3d6-cc84a90b957b tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] 10.222.0.18 "GET /compute/v2.1/servers/72af7667-a283-4567-894f-2bd233c01001" status: 200 len: 1407 microversion: 2.20 time: 0.402826 Jun 24 16:36:56.280124 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 245/511] 10.222.0.18 () {60 vars in 1276 bytes} [Fri Jun 24 16:36:55 2022] GET /compute/v2.1/servers/72af7667-a283-4567-894f-2bd233c01001 => generated 1407 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 16:36:56.911442 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [req-e69cd664-5ecc-4a3a-a3e3-d1716f0148cd req-a1745f52-1c97-4f2e-875a-831eb0dd0129 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "72af7667-a283-4567-894f-2bd233c01001", "name": "network-vif-plugged", "status": "completed", "tag": "87b332d5-d83a-40ca-bb6b-503444dbbfbe"}]} {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 16:36:56.913160 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 24 16:36:56.913160 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: warnings.warn(msg) Jun 24 16:36:56.922851 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [req-e69cd664-5ecc-4a3a-a3e3-d1716f0148cd req-a1745f52-1c97-4f2e-875a-831eb0dd0129 service nova] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:36:56.923427 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [req-e69cd664-5ecc-4a3a-a3e3-d1716f0148cd req-a1745f52-1c97-4f2e-875a-831eb0dd0129 service nova] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:36:56.951444 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.compute.server_external_events [req-e69cd664-5ecc-4a3a-a3e3-d1716f0148cd req-a1745f52-1c97-4f2e-875a-831eb0dd0129 service nova] Creating event network-vif-plugged:87b332d5-d83a-40ca-bb6b-503444dbbfbe for instance 72af7667-a283-4567-894f-2bd233c01001 on hv-cinder-84718 Jun 24 16:36:56.961107 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [req-e69cd664-5ecc-4a3a-a3e3-d1716f0148cd req-a1745f52-1c97-4f2e-875a-831eb0dd0129 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053090 Jun 24 16:36:56.962068 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 267/512] 10.222.0.18 () {64 vars in 1317 bytes} [Fri Jun 24 16:36:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 16:36:57.289250 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-0902eeca-508a-418d-9e67-dd2676050f8c tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] Calling method '>' {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:36:57.290018 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-0902eeca-508a-418d-9e67-dd2676050f8c tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] [instance: bd57f4a8-0078-4dde-ac34-901a40bc7b8e] Fetching instance by UUID {{(pid=102149) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:36:57.304961 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-0902eeca-508a-418d-9e67-dd2676050f8c tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:36:57.306101 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-0902eeca-508a-418d-9e67-dd2676050f8c tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:36:57.307940 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-0902eeca-508a-418d-9e67-dd2676050f8c tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:36:57.309991 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-0902eeca-508a-418d-9e67-dd2676050f8c tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:36:57.313362 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-8bee47fe-6cee-409a-b10e-962be0856d36 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Calling method '>' {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:36:57.314617 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-8bee47fe-6cee-409a-b10e-962be0856d36 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] [instance: 72af7667-a283-4567-894f-2bd233c01001] Fetching instance by UUID {{(pid=102148) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:36:57.331875 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-8bee47fe-6cee-409a-b10e-962be0856d36 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:36:57.332572 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-8bee47fe-6cee-409a-b10e-962be0856d36 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:36:57.333428 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-8bee47fe-6cee-409a-b10e-962be0856d36 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:36:57.333962 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-8bee47fe-6cee-409a-b10e-962be0856d36 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:36:57.745208 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-8bee47fe-6cee-409a-b10e-962be0856d36 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7489b29cb3ef47d78dfd55794f338b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065254ebe67545639644fcbc6bd9fc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:36:57.758611 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-0902eeca-508a-418d-9e67-dd2676050f8c tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b823267a02a465192aadb5a1c5a3d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34b225f93234ca38c8d0c3d37ba0b8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:36:57.762385 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-8bee47fe-6cee-409a-b10e-962be0856d36 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7489b29cb3ef47d78dfd55794f338b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065254ebe67545639644fcbc6bd9fc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:36:57.765267 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-8bee47fe-6cee-409a-b10e-962be0856d36 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7489b29cb3ef47d78dfd55794f338b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065254ebe67545639644fcbc6bd9fc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:36:57.766923 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-8bee47fe-6cee-409a-b10e-962be0856d36 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] 10.222.0.18 "GET /compute/v2.1/servers/72af7667-a283-4567-894f-2bd233c01001" status: 200 len: 1407 microversion: 2.20 time: 0.462544 Jun 24 16:36:57.767871 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 268/513] 10.222.0.18 () {60 vars in 1276 bytes} [Fri Jun 24 16:36:57 2022] GET /compute/v2.1/servers/72af7667-a283-4567-894f-2bd233c01001 => generated 1407 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 16:36:57.773267 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-0902eeca-508a-418d-9e67-dd2676050f8c tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] 10.222.0.18 "GET /compute/v2.1/servers/bd57f4a8-0078-4dde-ac34-901a40bc7b8e" status: 200 len: 1444 microversion: 2.1 time: 0.487561 Jun 24 16:36:57.774642 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 246/514] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:36:57 2022] GET /compute/v2.1/servers/bd57f4a8-0078-4dde-ac34-901a40bc7b8e => generated 1444 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 16:36:57.776528 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-ca4fa860-e10c-4b24-af63-890ba7467309 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Calling method '>' {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:36:57.777335 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-ca4fa860-e10c-4b24-af63-890ba7467309 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] [instance: 1739cd84-3709-4cf4-95e3-82de4b4d3d7a] Fetching instance by UUID {{(pid=102148) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:36:57.790473 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-ca4fa860-e10c-4b24-af63-890ba7467309 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:36:57.791247 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-ca4fa860-e10c-4b24-af63-890ba7467309 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:36:57.792598 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-ca4fa860-e10c-4b24-af63-890ba7467309 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:36:57.793459 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-ca4fa860-e10c-4b24-af63-890ba7467309 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:36:57.800525 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-046511ac-173b-4e26-9e22-713c621225ad tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] Calling method '>' {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:36:57.801140 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-046511ac-173b-4e26-9e22-713c621225ad tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] [instance: bd57f4a8-0078-4dde-ac34-901a40bc7b8e] Fetching instance by UUID {{(pid=102149) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:36:57.809608 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-046511ac-173b-4e26-9e22-713c621225ad tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:36:57.810055 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-046511ac-173b-4e26-9e22-713c621225ad tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:36:57.810886 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-046511ac-173b-4e26-9e22-713c621225ad tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:36:57.811323 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-046511ac-173b-4e26-9e22-713c621225ad tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:36:58.032271 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.objects.instance [None req-ca4fa860-e10c-4b24-af63-890ba7467309 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lazy-loading 'services' on Instance uuid 1739cd84-3709-4cf4-95e3-82de4b4d3d7a {{(pid=102148) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Jun 24 16:36:58.109300 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-046511ac-173b-4e26-9e22-713c621225ad tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b823267a02a465192aadb5a1c5a3d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34b225f93234ca38c8d0c3d37ba0b8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:36:58.123914 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-046511ac-173b-4e26-9e22-713c621225ad tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] 10.222.0.18 "GET /compute/v2.1/servers/bd57f4a8-0078-4dde-ac34-901a40bc7b8e" status: 200 len: 1444 microversion: 2.1 time: 0.328492 Jun 24 16:36:58.124927 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 247/515] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:36:57 2022] GET /compute/v2.1/servers/bd57f4a8-0078-4dde-ac34-901a40bc7b8e => generated 1444 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 16:36:58.234801 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-ca4fa860-e10c-4b24-af63-890ba7467309 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] 10.222.0.18 "DELETE /compute/v2.1/servers/1739cd84-3709-4cf4-95e3-82de4b4d3d7a/os-volume_attachments/5f9484b2-a8b8-44e8-9f61-276808d424fa" status: 202 len: 0 microversion: 2.1 time: 0.464561 Jun 24 16:36:58.236270 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 269/516] 10.222.0.18 () {58 vars in 1415 bytes} [Fri Jun 24 16:36:57 2022] DELETE /compute/v2.1/servers/1739cd84-3709-4cf4-95e3-82de4b4d3d7a/os-volume_attachments/5f9484b2-a8b8-44e8-9f61-276808d424fa => generated 0 bytes in 468 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 24 16:36:58.253526 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-1ddac176-aa73-447f-865a-99fadd2afae2 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Calling method '>' {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:36:58.255222 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-1ddac176-aa73-447f-865a-99fadd2afae2 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] [instance: 1739cd84-3709-4cf4-95e3-82de4b4d3d7a] Fetching instance by UUID {{(pid=102149) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:36:58.265573 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-1ddac176-aa73-447f-865a-99fadd2afae2 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:36:58.267006 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-1ddac176-aa73-447f-865a-99fadd2afae2 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:36:58.268344 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-1ddac176-aa73-447f-865a-99fadd2afae2 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:36:58.268936 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-1ddac176-aa73-447f-865a-99fadd2afae2 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:36:58.407234 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-1ddac176-aa73-447f-865a-99fadd2afae2 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] 10.222.0.18 "GET /compute/v2.1/servers/1739cd84-3709-4cf4-95e3-82de4b4d3d7a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.163701 Jun 24 16:36:58.410080 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 248/517] 10.222.0.18 () {58 vars in 1301 bytes} [Fri Jun 24 16:36:58 2022] GET /compute/v2.1/servers/1739cd84-3709-4cf4-95e3-82de4b4d3d7a/os-volume_attachments => generated 197 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 16:36:58.791782 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-ad251f5b-f981-41ed-b7fa-91cbf506c64a tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Calling method '>' {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:36:58.792486 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-ad251f5b-f981-41ed-b7fa-91cbf506c64a tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] [instance: 72af7667-a283-4567-894f-2bd233c01001] Fetching instance by UUID {{(pid=102148) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:36:58.805761 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-ad251f5b-f981-41ed-b7fa-91cbf506c64a tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:36:58.806336 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-ad251f5b-f981-41ed-b7fa-91cbf506c64a tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:36:58.807833 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-ad251f5b-f981-41ed-b7fa-91cbf506c64a tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:36:58.808849 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-ad251f5b-f981-41ed-b7fa-91cbf506c64a tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:36:59.133113 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-ad251f5b-f981-41ed-b7fa-91cbf506c64a tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7489b29cb3ef47d78dfd55794f338b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065254ebe67545639644fcbc6bd9fc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:36:59.148389 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-ad251f5b-f981-41ed-b7fa-91cbf506c64a tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7489b29cb3ef47d78dfd55794f338b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065254ebe67545639644fcbc6bd9fc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:36:59.151549 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-ad251f5b-f981-41ed-b7fa-91cbf506c64a tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7489b29cb3ef47d78dfd55794f338b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065254ebe67545639644fcbc6bd9fc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:36:59.153690 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-ad251f5b-f981-41ed-b7fa-91cbf506c64a tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] 10.222.0.18 "GET /compute/v2.1/servers/72af7667-a283-4567-894f-2bd233c01001" status: 200 len: 1407 microversion: 2.20 time: 0.367283 Jun 24 16:36:59.162294 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 270/518] 10.222.0.18 () {60 vars in 1276 bytes} [Fri Jun 24 16:36:58 2022] GET /compute/v2.1/servers/72af7667-a283-4567-894f-2bd233c01001 => generated 1407 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 16:36:59.426505 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-42fbdb54-13c4-413a-bfd1-e43e559ec3be tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Calling method '>' {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:36:59.428985 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-42fbdb54-13c4-413a-bfd1-e43e559ec3be tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] [instance: 1739cd84-3709-4cf4-95e3-82de4b4d3d7a] Fetching instance by UUID {{(pid=102149) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:36:59.442180 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-42fbdb54-13c4-413a-bfd1-e43e559ec3be tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:36:59.443787 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-42fbdb54-13c4-413a-bfd1-e43e559ec3be tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:36:59.445326 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-42fbdb54-13c4-413a-bfd1-e43e559ec3be tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:36:59.446226 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-42fbdb54-13c4-413a-bfd1-e43e559ec3be tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:36:59.531392 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-42fbdb54-13c4-413a-bfd1-e43e559ec3be tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] 10.222.0.18 "GET /compute/v2.1/servers/1739cd84-3709-4cf4-95e3-82de4b4d3d7a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.112813 Jun 24 16:36:59.531994 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 249/519] 10.222.0.18 () {58 vars in 1301 bytes} [Fri Jun 24 16:36:59 2022] GET /compute/v2.1/servers/1739cd84-3709-4cf4-95e3-82de4b4d3d7a/os-volume_attachments => generated 197 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 16:37:00.177952 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-9af77456-bd7b-44e9-af80-645b8af72ba8 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Calling method '>' {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:37:00.178811 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-9af77456-bd7b-44e9-af80-645b8af72ba8 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] [instance: 72af7667-a283-4567-894f-2bd233c01001] Fetching instance by UUID {{(pid=102148) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:37:00.187176 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-9af77456-bd7b-44e9-af80-645b8af72ba8 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:37:00.187723 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-9af77456-bd7b-44e9-af80-645b8af72ba8 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:37:00.188606 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-9af77456-bd7b-44e9-af80-645b8af72ba8 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:37:00.189297 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-9af77456-bd7b-44e9-af80-645b8af72ba8 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:37:00.496191 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-9af77456-bd7b-44e9-af80-645b8af72ba8 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7489b29cb3ef47d78dfd55794f338b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065254ebe67545639644fcbc6bd9fc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:37:00.506958 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-9af77456-bd7b-44e9-af80-645b8af72ba8 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7489b29cb3ef47d78dfd55794f338b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065254ebe67545639644fcbc6bd9fc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:37:00.509024 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-9af77456-bd7b-44e9-af80-645b8af72ba8 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7489b29cb3ef47d78dfd55794f338b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065254ebe67545639644fcbc6bd9fc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:37:00.510788 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-9af77456-bd7b-44e9-af80-645b8af72ba8 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] 10.222.0.18 "GET /compute/v2.1/servers/72af7667-a283-4567-894f-2bd233c01001" status: 200 len: 1599 microversion: 2.20 time: 0.338527 Jun 24 16:37:00.512734 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 271/520] 10.222.0.18 () {60 vars in 1276 bytes} [Fri Jun 24 16:37:00 2022] GET /compute/v2.1/servers/72af7667-a283-4567-894f-2bd233c01001 => generated 1599 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 16:37:00.540569 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-8b7e784f-8fbf-444b-8945-cd47fee14976 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Calling method '>' {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:37:00.541899 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-8b7e784f-8fbf-444b-8945-cd47fee14976 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] [instance: 72af7667-a283-4567-894f-2bd233c01001] Fetching instance by UUID {{(pid=102149) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:37:00.544861 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-b81b4b6c-5aa2-46c3-b53f-6c9f46d4cef1 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Calling method '>' {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:37:00.545929 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-b81b4b6c-5aa2-46c3-b53f-6c9f46d4cef1 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] [instance: 1739cd84-3709-4cf4-95e3-82de4b4d3d7a] Fetching instance by UUID {{(pid=102148) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:37:00.553125 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-8b7e784f-8fbf-444b-8945-cd47fee14976 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:37:00.554389 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-8b7e784f-8fbf-444b-8945-cd47fee14976 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:37:00.556108 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-8b7e784f-8fbf-444b-8945-cd47fee14976 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:37:00.556991 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-8b7e784f-8fbf-444b-8945-cd47fee14976 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:37:00.565728 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-b81b4b6c-5aa2-46c3-b53f-6c9f46d4cef1 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:37:00.566303 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-b81b4b6c-5aa2-46c3-b53f-6c9f46d4cef1 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:37:00.568863 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-b81b4b6c-5aa2-46c3-b53f-6c9f46d4cef1 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:37:00.569326 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-b81b4b6c-5aa2-46c3-b53f-6c9f46d4cef1 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:37:00.678024 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-b81b4b6c-5aa2-46c3-b53f-6c9f46d4cef1 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] 10.222.0.18 "GET /compute/v2.1/servers/1739cd84-3709-4cf4-95e3-82de4b4d3d7a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.137837 Jun 24 16:37:00.682214 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 272/521] 10.222.0.18 () {58 vars in 1301 bytes} [Fri Jun 24 16:37:00 2022] GET /compute/v2.1/servers/1739cd84-3709-4cf4-95e3-82de4b4d3d7a/os-volume_attachments => generated 197 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 16:37:00.803660 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-8b7e784f-8fbf-444b-8945-cd47fee14976 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] 10.222.0.18 "GET /compute/v2.1/servers/72af7667-a283-4567-894f-2bd233c01001/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.268139 Jun 24 16:37:00.805989 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 250/522] 10.222.0.18 () {60 vars in 1315 bytes} [Fri Jun 24 16:37:00 2022] GET /compute/v2.1/servers/72af7667-a283-4567-894f-2bd233c01001/os-interface => generated 284 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 24 16:37:01.533559 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [req-f929763f-2dd6-4289-97de-09b9c2888652 req-286f7f60-8c1c-4564-85e8-f3c76cf22749 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bd57f4a8-0078-4dde-ac34-901a40bc7b8e", "tag": "6d2412c6-1db3-4737-baaa-2744c29fbff8"}]} {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 16:37:01.539445 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 24 16:37:01.539445 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: warnings.warn(msg) Jun 24 16:37:01.560922 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [req-f929763f-2dd6-4289-97de-09b9c2888652 req-286f7f60-8c1c-4564-85e8-f3c76cf22749 service nova] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:37:01.562240 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [req-f929763f-2dd6-4289-97de-09b9c2888652 req-286f7f60-8c1c-4564-85e8-f3c76cf22749 service nova] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:37:01.604647 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.compute.server_external_events [req-f929763f-2dd6-4289-97de-09b9c2888652 req-286f7f60-8c1c-4564-85e8-f3c76cf22749 service nova] Creating event network-changed:6d2412c6-1db3-4737-baaa-2744c29fbff8 for instance bd57f4a8-0078-4dde-ac34-901a40bc7b8e on hv-cinder-84718 Jun 24 16:37:01.615160 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [req-f929763f-2dd6-4289-97de-09b9c2888652 req-286f7f60-8c1c-4564-85e8-f3c76cf22749 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090914 Jun 24 16:37:01.616317 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 273/523] 10.222.0.18 () {64 vars in 1317 bytes} [Fri Jun 24 16:37:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 16:37:01.694817 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-8ecbf2d2-ab61-46cd-a53f-ad53320c7b0c tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Calling method '>' {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:37:01.696563 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-8ecbf2d2-ab61-46cd-a53f-ad53320c7b0c tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] [instance: 1739cd84-3709-4cf4-95e3-82de4b4d3d7a] Fetching instance by UUID {{(pid=102149) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:37:01.712430 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-8ecbf2d2-ab61-46cd-a53f-ad53320c7b0c tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:37:01.713645 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-8ecbf2d2-ab61-46cd-a53f-ad53320c7b0c tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:37:01.714945 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-8ecbf2d2-ab61-46cd-a53f-ad53320c7b0c tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:37:01.715433 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-8ecbf2d2-ab61-46cd-a53f-ad53320c7b0c tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:37:01.855676 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-8ecbf2d2-ab61-46cd-a53f-ad53320c7b0c tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] 10.222.0.18 "GET /compute/v2.1/servers/1739cd84-3709-4cf4-95e3-82de4b4d3d7a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.168751 Jun 24 16:37:01.857031 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 251/524] 10.222.0.18 () {58 vars in 1301 bytes} [Fri Jun 24 16:37:01 2022] GET /compute/v2.1/servers/1739cd84-3709-4cf4-95e3-82de4b4d3d7a/os-volume_attachments => generated 25 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 24 16:37:02.050209 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-42ddbd58-3fc1-43ca-bac9-182a03885a07 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Calling method '>' {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:37:02.051198 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-42ddbd58-3fc1-43ca-bac9-182a03885a07 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] [instance: 1739cd84-3709-4cf4-95e3-82de4b4d3d7a] Fetching instance by UUID {{(pid=102148) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:37:02.063191 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-42ddbd58-3fc1-43ca-bac9-182a03885a07 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:37:02.064041 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-42ddbd58-3fc1-43ca-bac9-182a03885a07 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:37:02.065346 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-42ddbd58-3fc1-43ca-bac9-182a03885a07 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:37:02.066174 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-42ddbd58-3fc1-43ca-bac9-182a03885a07 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:37:02.139723 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-42ddbd58-3fc1-43ca-bac9-182a03885a07 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] [instance: 1739cd84-3709-4cf4-95e3-82de4b4d3d7a] Going to try to terminate instance {{(pid=102148) delete /opt/stack/nova/nova/compute/api.py:2562}} Jun 24 16:37:02.296291 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-42ddbd58-3fc1-43ca-bac9-182a03885a07 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] 10.222.0.18 "DELETE /compute/v2.1/servers/1739cd84-3709-4cf4-95e3-82de4b4d3d7a" status: 204 len: 0 microversion: 2.1 time: 0.252011 Jun 24 16:37:02.297147 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 274/525] 10.222.0.18 () {58 vars in 1238 bytes} [Fri Jun 24 16:37:02 2022] DELETE /compute/v2.1/servers/1739cd84-3709-4cf4-95e3-82de4b4d3d7a => generated 0 bytes in 255 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 24 16:37:02.308883 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-632219d9-4d38-4d39-a509-cef7ed9d108b tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Calling method '>' {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:37:02.310114 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-632219d9-4d38-4d39-a509-cef7ed9d108b tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] [instance: 1739cd84-3709-4cf4-95e3-82de4b4d3d7a] Fetching instance by UUID {{(pid=102149) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:37:02.323823 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-632219d9-4d38-4d39-a509-cef7ed9d108b tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:37:02.324693 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-632219d9-4d38-4d39-a509-cef7ed9d108b tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:37:02.326110 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-632219d9-4d38-4d39-a509-cef7ed9d108b tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:37:02.326973 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-632219d9-4d38-4d39-a509-cef7ed9d108b tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:37:02.811602 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-632219d9-4d38-4d39-a509-cef7ed9d108b tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c286a3f03048689e5ec552bb89c161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09584de3a4b14c5a90eb9b1c2149d6fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:37:02.820206 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-632219d9-4d38-4d39-a509-cef7ed9d108b tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] 10.222.0.18 "GET /compute/v2.1/servers/1739cd84-3709-4cf4-95e3-82de4b4d3d7a" status: 200 len: 1689 microversion: 2.1 time: 0.518492 Jun 24 16:37:02.820991 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 252/526] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:37:02 2022] GET /compute/v2.1/servers/1739cd84-3709-4cf4-95e3-82de4b4d3d7a => generated 1689 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 16:37:03.044659 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [req-fc403845-6026-4294-bab6-c374935c3983 req-ba15c21a-dc21-40fa-b17c-47195502b15f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "72af7667-a283-4567-894f-2bd233c01001", "tag": "87b332d5-d83a-40ca-bb6b-503444dbbfbe"}]} {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 16:37:03.046220 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 24 16:37:03.046220 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: warnings.warn(msg) Jun 24 16:37:03.060882 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [req-fc403845-6026-4294-bab6-c374935c3983 req-ba15c21a-dc21-40fa-b17c-47195502b15f service nova] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:37:03.061515 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [req-fc403845-6026-4294-bab6-c374935c3983 req-ba15c21a-dc21-40fa-b17c-47195502b15f service nova] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:37:03.080448 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.compute.server_external_events [req-fc403845-6026-4294-bab6-c374935c3983 req-ba15c21a-dc21-40fa-b17c-47195502b15f service nova] Creating event network-changed:87b332d5-d83a-40ca-bb6b-503444dbbfbe for instance 72af7667-a283-4567-894f-2bd233c01001 on hv-cinder-84718 Jun 24 16:37:03.085999 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [req-fc403845-6026-4294-bab6-c374935c3983 req-ba15c21a-dc21-40fa-b17c-47195502b15f service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.126472 Jun 24 16:37:03.086866 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 275/527] 10.222.0.18 () {64 vars in 1317 bytes} [Fri Jun 24 16:37:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 16:37:03.837631 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-d886b495-f039-4c09-b00a-a2978d196c82 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Calling method '>' {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:37:03.838349 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-d886b495-f039-4c09-b00a-a2978d196c82 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] [instance: 1739cd84-3709-4cf4-95e3-82de4b4d3d7a] Fetching instance by UUID {{(pid=102149) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:37:03.846044 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-d886b495-f039-4c09-b00a-a2978d196c82 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:37:03.846589 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-d886b495-f039-4c09-b00a-a2978d196c82 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:37:03.847629 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-d886b495-f039-4c09-b00a-a2978d196c82 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:37:03.848099 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-d886b495-f039-4c09-b00a-a2978d196c82 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:37:04.089152 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-d886b495-f039-4c09-b00a-a2978d196c82 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c286a3f03048689e5ec552bb89c161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09584de3a4b14c5a90eb9b1c2149d6fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:37:04.101526 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-d886b495-f039-4c09-b00a-a2978d196c82 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] 10.222.0.18 "GET /compute/v2.1/servers/1739cd84-3709-4cf4-95e3-82de4b4d3d7a" status: 200 len: 1689 microversion: 2.1 time: 0.267338 Jun 24 16:37:04.102569 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 253/528] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:37:03 2022] GET /compute/v2.1/servers/1739cd84-3709-4cf4-95e3-82de4b4d3d7a => generated 1689 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 16:37:05.120123 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-01dc2b19-a4ae-4297-9bb6-8b0724a64491 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Calling method '>' {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:37:05.120832 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-01dc2b19-a4ae-4297-9bb6-8b0724a64491 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] [instance: 1739cd84-3709-4cf4-95e3-82de4b4d3d7a] Fetching instance by UUID {{(pid=102148) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:37:05.128896 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-01dc2b19-a4ae-4297-9bb6-8b0724a64491 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:37:05.129350 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-01dc2b19-a4ae-4297-9bb6-8b0724a64491 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:37:05.130137 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-01dc2b19-a4ae-4297-9bb6-8b0724a64491 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:37:05.131136 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-01dc2b19-a4ae-4297-9bb6-8b0724a64491 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:37:05.410921 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-01dc2b19-a4ae-4297-9bb6-8b0724a64491 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c286a3f03048689e5ec552bb89c161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09584de3a4b14c5a90eb9b1c2149d6fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:37:05.419398 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-01dc2b19-a4ae-4297-9bb6-8b0724a64491 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] 10.222.0.18 "GET /compute/v2.1/servers/1739cd84-3709-4cf4-95e3-82de4b4d3d7a" status: 200 len: 1689 microversion: 2.1 time: 0.303879 Jun 24 16:37:05.419972 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 276/529] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:37:05 2022] GET /compute/v2.1/servers/1739cd84-3709-4cf4-95e3-82de4b4d3d7a => generated 1689 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 16:37:06.437307 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-8c159e6f-182b-461e-a503-70462d33263b tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Calling method '>' {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:37:06.438004 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-8c159e6f-182b-461e-a503-70462d33263b tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] [instance: 1739cd84-3709-4cf4-95e3-82de4b4d3d7a] Fetching instance by UUID {{(pid=102149) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:37:06.446049 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-8c159e6f-182b-461e-a503-70462d33263b tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:37:06.446487 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-8c159e6f-182b-461e-a503-70462d33263b tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:37:06.447294 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-8c159e6f-182b-461e-a503-70462d33263b tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:37:06.447745 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-8c159e6f-182b-461e-a503-70462d33263b tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:37:06.673803 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-8c159e6f-182b-461e-a503-70462d33263b tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c286a3f03048689e5ec552bb89c161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09584de3a4b14c5a90eb9b1c2149d6fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:37:06.682366 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-8c159e6f-182b-461e-a503-70462d33263b tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] 10.222.0.18 "GET /compute/v2.1/servers/1739cd84-3709-4cf4-95e3-82de4b4d3d7a" status: 200 len: 1689 microversion: 2.1 time: 0.248718 Jun 24 16:37:06.682971 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 254/530] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:37:06 2022] GET /compute/v2.1/servers/1739cd84-3709-4cf4-95e3-82de4b4d3d7a => generated 1689 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 16:37:07.702549 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-ef325864-9281-4169-b1fc-404e45737318 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Calling method '>' {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:37:07.702549 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-ef325864-9281-4169-b1fc-404e45737318 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] [instance: 1739cd84-3709-4cf4-95e3-82de4b4d3d7a] Fetching instance by UUID {{(pid=102148) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:37:07.711252 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-ef325864-9281-4169-b1fc-404e45737318 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:37:07.711726 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-ef325864-9281-4169-b1fc-404e45737318 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:37:07.712460 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-ef325864-9281-4169-b1fc-404e45737318 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:37:07.712882 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-ef325864-9281-4169-b1fc-404e45737318 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:37:07.925854 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-ef325864-9281-4169-b1fc-404e45737318 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c286a3f03048689e5ec552bb89c161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09584de3a4b14c5a90eb9b1c2149d6fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:37:07.935108 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-ef325864-9281-4169-b1fc-404e45737318 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] 10.222.0.18 "GET /compute/v2.1/servers/1739cd84-3709-4cf4-95e3-82de4b4d3d7a" status: 200 len: 1689 microversion: 2.1 time: 0.236845 Jun 24 16:37:07.935643 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 277/531] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:37:07 2022] GET /compute/v2.1/servers/1739cd84-3709-4cf4-95e3-82de4b4d3d7a => generated 1689 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 16:37:08.371448 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-037a8eb1-ae3a-4949-9dc5-9c1b72003041 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Calling method '>' {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:37:08.372176 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-037a8eb1-ae3a-4949-9dc5-9c1b72003041 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] [instance: 41c16116-97cf-4394-8c41-2d57d447d422] Fetching instance by UUID {{(pid=102149) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:37:08.379816 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-037a8eb1-ae3a-4949-9dc5-9c1b72003041 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:37:08.380893 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-037a8eb1-ae3a-4949-9dc5-9c1b72003041 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:37:08.381857 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-037a8eb1-ae3a-4949-9dc5-9c1b72003041 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:37:08.382302 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-037a8eb1-ae3a-4949-9dc5-9c1b72003041 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:37:08.446216 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-037a8eb1-ae3a-4949-9dc5-9c1b72003041 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] 10.222.0.18 "GET /compute/v2.1/servers/41c16116-97cf-4394-8c41-2d57d447d422/ips" status: 200 len: 150 microversion: 2.1 time: 0.216056 Jun 24 16:37:08.446793 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 255/532] 10.222.0.18 () {58 vars in 1247 bytes} [Fri Jun 24 16:37:08 2022] GET /compute/v2.1/servers/41c16116-97cf-4394-8c41-2d57d447d422/ips => generated 150 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 16:37:08.952449 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-18266f25-73c2-476f-ad7a-b85577a548a5 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Calling method '>' {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:37:08.953058 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-18266f25-73c2-476f-ad7a-b85577a548a5 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] [instance: 1739cd84-3709-4cf4-95e3-82de4b4d3d7a] Fetching instance by UUID {{(pid=102148) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:37:08.961690 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-18266f25-73c2-476f-ad7a-b85577a548a5 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:37:08.962274 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-18266f25-73c2-476f-ad7a-b85577a548a5 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:37:08.963274 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-18266f25-73c2-476f-ad7a-b85577a548a5 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:37:08.963767 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-18266f25-73c2-476f-ad7a-b85577a548a5 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:37:09.208983 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-18266f25-73c2-476f-ad7a-b85577a548a5 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c286a3f03048689e5ec552bb89c161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09584de3a4b14c5a90eb9b1c2149d6fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:37:09.222300 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-18266f25-73c2-476f-ad7a-b85577a548a5 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] 10.222.0.18 "GET /compute/v2.1/servers/1739cd84-3709-4cf4-95e3-82de4b4d3d7a" status: 200 len: 1689 microversion: 2.1 time: 0.273349 Jun 24 16:37:09.223313 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 278/533] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:37:08 2022] GET /compute/v2.1/servers/1739cd84-3709-4cf4-95e3-82de4b4d3d7a => generated 1689 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 16:37:09.985799 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-7dc2c582-f9d8-4b3f-a285-3e797ee3e595 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "bef85cc0-4490-453a-aeeb-011c3965df12"}} {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 16:37:09.987747 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-7dc2c582-f9d8-4b3f-a285-3e797ee3e595 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] [instance: 41c16116-97cf-4394-8c41-2d57d447d422] Fetching instance by UUID {{(pid=102149) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:37:09.998296 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-7dc2c582-f9d8-4b3f-a285-3e797ee3e595 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:37:09.998900 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-7dc2c582-f9d8-4b3f-a285-3e797ee3e595 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:37:09.999812 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-7dc2c582-f9d8-4b3f-a285-3e797ee3e595 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:37:10.000629 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-7dc2c582-f9d8-4b3f-a285-3e797ee3e595 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:37:10.251690 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-8bb904e6-d40e-4b2c-be23-08b9e73822e3 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Calling method '>' {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:37:10.252304 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-8bb904e6-d40e-4b2c-be23-08b9e73822e3 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] [instance: 1739cd84-3709-4cf4-95e3-82de4b4d3d7a] Fetching instance by UUID {{(pid=102148) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:37:10.263936 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-8bb904e6-d40e-4b2c-be23-08b9e73822e3 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:37:10.265017 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-8bb904e6-d40e-4b2c-be23-08b9e73822e3 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:37:10.265603 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-8bb904e6-d40e-4b2c-be23-08b9e73822e3 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:37:10.266041 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-8bb904e6-d40e-4b2c-be23-08b9e73822e3 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:37:10.457235 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-7dc2c582-f9d8-4b3f-a285-3e797ee3e595 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] 10.222.0.18 "POST /compute/v2.1/servers/41c16116-97cf-4394-8c41-2d57d447d422/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.478449 Jun 24 16:37:10.457843 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 256/534] 10.222.0.18 () {60 vars in 1322 bytes} [Fri Jun 24 16:37:09 2022] POST /compute/v2.1/servers/41c16116-97cf-4394-8c41-2d57d447d422/os-volume_attachments => generated 194 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 16:37:10.808261 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-8bb904e6-d40e-4b2c-be23-08b9e73822e3 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c286a3f03048689e5ec552bb89c161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09584de3a4b14c5a90eb9b1c2149d6fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:37:10.818312 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-8bb904e6-d40e-4b2c-be23-08b9e73822e3 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] 10.222.0.18 "GET /compute/v2.1/servers/1739cd84-3709-4cf4-95e3-82de4b4d3d7a" status: 200 len: 1689 microversion: 2.1 time: 0.569812 Jun 24 16:37:10.818958 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 279/535] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:37:10 2022] GET /compute/v2.1/servers/1739cd84-3709-4cf4-95e3-82de4b4d3d7a => generated 1689 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 16:37:11.608241 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [req-6d486163-d685-4b6c-8bbf-89431ed9647b req-567a1be8-2ceb-4a63-9d12-d2e217cca86d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1739cd84-3709-4cf4-95e3-82de4b4d3d7a", "name": "network-vif-deleted", "tag": "8a215961-1299-415e-b991-1271a78f7ae0"}]} {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 16:37:11.611702 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 24 16:37:11.611702 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: warnings.warn(msg) Jun 24 16:37:11.635106 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [req-6d486163-d685-4b6c-8bbf-89431ed9647b req-567a1be8-2ceb-4a63-9d12-d2e217cca86d service nova] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:37:11.635700 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [req-6d486163-d685-4b6c-8bbf-89431ed9647b req-567a1be8-2ceb-4a63-9d12-d2e217cca86d service nova] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:37:11.662661 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.compute.server_external_events [req-6d486163-d685-4b6c-8bbf-89431ed9647b req-567a1be8-2ceb-4a63-9d12-d2e217cca86d service nova] Creating event network-vif-deleted:8a215961-1299-415e-b991-1271a78f7ae0 for instance 1739cd84-3709-4cf4-95e3-82de4b4d3d7a on hv-cinder-84718 Jun 24 16:37:11.669252 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [req-6d486163-d685-4b6c-8bbf-89431ed9647b req-567a1be8-2ceb-4a63-9d12-d2e217cca86d service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070265 Jun 24 16:37:11.669942 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 257/536] 10.222.0.18 () {64 vars in 1317 bytes} [Fri Jun 24 16:37:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 16:37:11.841447 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-6eb6a398-1a6d-42d4-8538-3631f496b8d7 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Calling method '>' {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:37:11.842169 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-6eb6a398-1a6d-42d4-8538-3631f496b8d7 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] [instance: 1739cd84-3709-4cf4-95e3-82de4b4d3d7a] Fetching instance by UUID {{(pid=102148) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:37:11.849706 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-6eb6a398-1a6d-42d4-8538-3631f496b8d7 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:37:11.850148 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-6eb6a398-1a6d-42d4-8538-3631f496b8d7 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:37:11.851132 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-6eb6a398-1a6d-42d4-8538-3631f496b8d7 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:37:11.851596 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-6eb6a398-1a6d-42d4-8538-3631f496b8d7 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:37:11.923907 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-6eb6a398-1a6d-42d4-8538-3631f496b8d7 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:37:11.924555 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-6eb6a398-1a6d-42d4-8538-3631f496b8d7 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:37:11.924555 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.objects.instance [None req-6eb6a398-1a6d-42d4-8538-3631f496b8d7 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lazy-loading 'fault' on Instance uuid 1739cd84-3709-4cf4-95e3-82de4b4d3d7a {{(pid=102148) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Jun 24 16:37:12.012389 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-6eb6a398-1a6d-42d4-8538-3631f496b8d7 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c286a3f03048689e5ec552bb89c161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09584de3a4b14c5a90eb9b1c2149d6fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:37:12.021387 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-6eb6a398-1a6d-42d4-8538-3631f496b8d7 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] 10.222.0.18 "GET /compute/v2.1/servers/1739cd84-3709-4cf4-95e3-82de4b4d3d7a" status: 200 len: 1334 microversion: 2.1 time: 0.184617 Jun 24 16:37:12.021954 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 280/537] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:37:11 2022] GET /compute/v2.1/servers/1739cd84-3709-4cf4-95e3-82de4b4d3d7a => generated 1334 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 16:37:13.039080 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-2ee28887-637e-4aa6-ae96-07e95d649dba tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Calling method '>' {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:37:13.039759 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-2ee28887-637e-4aa6-ae96-07e95d649dba tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] [instance: 1739cd84-3709-4cf4-95e3-82de4b4d3d7a] Fetching instance by UUID {{(pid=102149) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:37:13.047623 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-2ee28887-637e-4aa6-ae96-07e95d649dba tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:37:13.048069 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-2ee28887-637e-4aa6-ae96-07e95d649dba tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:37:13.048839 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-2ee28887-637e-4aa6-ae96-07e95d649dba tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:37:13.049264 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-2ee28887-637e-4aa6-ae96-07e95d649dba tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:37:13.101086 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.wsgi [None req-2ee28887-637e-4aa6-ae96-07e95d649dba tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] HTTP exception thrown: Instance 1739cd84-3709-4cf4-95e3-82de4b4d3d7a could not be found. Jun 24 16:37:13.101683 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-2ee28887-637e-4aa6-ae96-07e95d649dba tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Returning 404 to user: Instance 1739cd84-3709-4cf4-95e3-82de4b4d3d7a could not be found. {{(pid=102149) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jun 24 16:37:13.102519 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-2ee28887-637e-4aa6-ae96-07e95d649dba tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] 10.222.0.18 "GET /compute/v2.1/servers/1739cd84-3709-4cf4-95e3-82de4b4d3d7a" status: 404 len: 111 microversion: 2.1 time: 0.067698 Jun 24 16:37:13.103410 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 258/538] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:37:13 2022] GET /compute/v2.1/servers/1739cd84-3709-4cf4-95e3-82de4b4d3d7a => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 16:37:13.111725 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-1db22b5a-2d44-43c8-8492-5c50c10abe7e tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Calling method '.version_select at 0x7f1ae800fe50>' {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:37:13.157850 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-1db22b5a-2d44-43c8-8492-5c50c10abe7e tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-554596742" status: 202 len: 0 microversion: 2.1 time: 0.049693 Jun 24 16:37:13.158567 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 281/539] 10.222.0.18 () {58 vars in 1217 bytes} [Fri Jun 24 16:37:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-554596742 => generated 0 bytes in 51 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 24 16:37:13.501235 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-54d467e3-ff64-4431-9729-3dac18a69037 tempest-VolumesSnapshotTestJSON-1294974655 tempest-VolumesSnapshotTestJSON-1294974655-project] Calling method '>' {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:37:13.501728 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-54d467e3-ff64-4431-9729-3dac18a69037 tempest-VolumesSnapshotTestJSON-1294974655 tempest-VolumesSnapshotTestJSON-1294974655-project] [instance: 6eb54c20-7da4-4c74-84fa-bc8e02d41498] Fetching instance by UUID {{(pid=102149) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:37:13.509937 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-54d467e3-ff64-4431-9729-3dac18a69037 tempest-VolumesSnapshotTestJSON-1294974655 tempest-VolumesSnapshotTestJSON-1294974655-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:37:13.510286 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-54d467e3-ff64-4431-9729-3dac18a69037 tempest-VolumesSnapshotTestJSON-1294974655 tempest-VolumesSnapshotTestJSON-1294974655-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:37:13.511097 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-54d467e3-ff64-4431-9729-3dac18a69037 tempest-VolumesSnapshotTestJSON-1294974655 tempest-VolumesSnapshotTestJSON-1294974655-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:37:13.511532 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-54d467e3-ff64-4431-9729-3dac18a69037 tempest-VolumesSnapshotTestJSON-1294974655 tempest-VolumesSnapshotTestJSON-1294974655-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:37:13.704727 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.objects.instance [None req-54d467e3-ff64-4431-9729-3dac18a69037 tempest-VolumesSnapshotTestJSON-1294974655 tempest-VolumesSnapshotTestJSON-1294974655-project] Lazy-loading 'services' on Instance uuid 6eb54c20-7da4-4c74-84fa-bc8e02d41498 {{(pid=102149) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Jun 24 16:37:13.877261 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-54d467e3-ff64-4431-9729-3dac18a69037 tempest-VolumesSnapshotTestJSON-1294974655 tempest-VolumesSnapshotTestJSON-1294974655-project] 10.222.0.18 "DELETE /compute/v2.1/servers/6eb54c20-7da4-4c74-84fa-bc8e02d41498/os-volume_attachments/24baca46-6bec-4df4-aced-77062af1c687" status: 202 len: 0 microversion: 2.1 time: 0.379231 Jun 24 16:37:13.878474 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 259/540] 10.222.0.18 () {58 vars in 1415 bytes} [Fri Jun 24 16:37:13 2022] DELETE /compute/v2.1/servers/6eb54c20-7da4-4c74-84fa-bc8e02d41498/os-volume_attachments/24baca46-6bec-4df4-aced-77062af1c687 => generated 0 bytes in 382 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 24 16:37:17.033008 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-9ec8b0b1-c34f-42c2-a674-22d22427d067 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Calling method '>' {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:37:17.033672 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-9ec8b0b1-c34f-42c2-a674-22d22427d067 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] [instance: 1c690e22-ec9b-423d-9f32-e01ffb3fa4b1] Fetching instance by UUID {{(pid=102148) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:37:17.041067 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-9ec8b0b1-c34f-42c2-a674-22d22427d067 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:37:17.041512 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-9ec8b0b1-c34f-42c2-a674-22d22427d067 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:37:17.042290 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-9ec8b0b1-c34f-42c2-a674-22d22427d067 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:37:17.042735 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-9ec8b0b1-c34f-42c2-a674-22d22427d067 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:37:17.109375 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-9ec8b0b1-c34f-42c2-a674-22d22427d067 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] [instance: 1c690e22-ec9b-423d-9f32-e01ffb3fa4b1] Going to try to terminate instance {{(pid=102148) delete /opt/stack/nova/nova/compute/api.py:2562}} Jun 24 16:37:17.237123 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-9ec8b0b1-c34f-42c2-a674-22d22427d067 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] 10.222.0.18 "DELETE /compute/v2.1/servers/1c690e22-ec9b-423d-9f32-e01ffb3fa4b1" status: 204 len: 0 microversion: 2.1 time: 0.206435 Jun 24 16:37:17.238458 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 282/541] 10.222.0.18 () {58 vars in 1238 bytes} [Fri Jun 24 16:37:17 2022] DELETE /compute/v2.1/servers/1c690e22-ec9b-423d-9f32-e01ffb3fa4b1 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 24 16:37:17.252682 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-7429dc35-bb70-4edb-be00-2f49ca0050be tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Calling method '>' {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:37:17.253840 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-7429dc35-bb70-4edb-be00-2f49ca0050be tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] [instance: 1c690e22-ec9b-423d-9f32-e01ffb3fa4b1] Fetching instance by UUID {{(pid=102149) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:37:17.279088 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-7429dc35-bb70-4edb-be00-2f49ca0050be tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:37:17.279843 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-7429dc35-bb70-4edb-be00-2f49ca0050be tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:37:17.281139 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-7429dc35-bb70-4edb-be00-2f49ca0050be tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:37:17.281858 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-7429dc35-bb70-4edb-be00-2f49ca0050be tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:37:17.632816 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-7429dc35-bb70-4edb-be00-2f49ca0050be tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c286a3f03048689e5ec552bb89c161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09584de3a4b14c5a90eb9b1c2149d6fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:37:17.641770 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-7429dc35-bb70-4edb-be00-2f49ca0050be tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] 10.222.0.18 "GET /compute/v2.1/servers/1c690e22-ec9b-423d-9f32-e01ffb3fa4b1" status: 200 len: 1507 microversion: 2.1 time: 0.396677 Jun 24 16:37:17.642350 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 260/542] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:37:17 2022] GET /compute/v2.1/servers/1c690e22-ec9b-423d-9f32-e01ffb3fa4b1 => generated 1507 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 16:37:18.540271 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-78c2d0dc-ed3a-484e-bacc-eeda0d12b18d tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "bef85cc0-4490-453a-aeeb-011c3965df12"}} {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 16:37:18.542778 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-78c2d0dc-ed3a-484e-bacc-eeda0d12b18d tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] [instance: 41c16116-97cf-4394-8c41-2d57d447d422] Fetching instance by UUID {{(pid=102148) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:37:18.550127 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-1691e725-1f72-4396-a941-d5d3ab0d45b1 tempest-VolumesSnapshotTestJSON-1294974655 tempest-VolumesSnapshotTestJSON-1294974655-project] Calling method '>' {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:37:18.550722 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-1691e725-1f72-4396-a941-d5d3ab0d45b1 tempest-VolumesSnapshotTestJSON-1294974655 tempest-VolumesSnapshotTestJSON-1294974655-project] [instance: 6eb54c20-7da4-4c74-84fa-bc8e02d41498] Fetching instance by UUID {{(pid=102149) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:37:18.555720 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-78c2d0dc-ed3a-484e-bacc-eeda0d12b18d tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:37:18.559674 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-78c2d0dc-ed3a-484e-bacc-eeda0d12b18d tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:37:18.560247 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-1691e725-1f72-4396-a941-d5d3ab0d45b1 tempest-VolumesSnapshotTestJSON-1294974655 tempest-VolumesSnapshotTestJSON-1294974655-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:37:18.560974 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-1691e725-1f72-4396-a941-d5d3ab0d45b1 tempest-VolumesSnapshotTestJSON-1294974655 tempest-VolumesSnapshotTestJSON-1294974655-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:37:18.561097 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-78c2d0dc-ed3a-484e-bacc-eeda0d12b18d tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:37:18.561679 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-78c2d0dc-ed3a-484e-bacc-eeda0d12b18d tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:37:18.562325 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-1691e725-1f72-4396-a941-d5d3ab0d45b1 tempest-VolumesSnapshotTestJSON-1294974655 tempest-VolumesSnapshotTestJSON-1294974655-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:37:18.563088 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-1691e725-1f72-4396-a941-d5d3ab0d45b1 tempest-VolumesSnapshotTestJSON-1294974655 tempest-VolumesSnapshotTestJSON-1294974655-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:37:18.655335 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-1691e725-1f72-4396-a941-d5d3ab0d45b1 tempest-VolumesSnapshotTestJSON-1294974655 tempest-VolumesSnapshotTestJSON-1294974655-project] [instance: 6eb54c20-7da4-4c74-84fa-bc8e02d41498] Going to try to terminate instance {{(pid=102149) delete /opt/stack/nova/nova/compute/api.py:2562}} Jun 24 16:37:18.785568 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.wsgi [None req-78c2d0dc-ed3a-484e-bacc-eeda0d12b18d tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] HTTP exception thrown: Invalid volume: volume bef85cc0-4490-453a-aeeb-011c3965df12 is already attached to instances: 41c16116-97cf-4394-8c41-2d57d447d422 Jun 24 16:37:18.787194 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-78c2d0dc-ed3a-484e-bacc-eeda0d12b18d tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Returning 400 to user: Invalid volume: volume bef85cc0-4490-453a-aeeb-011c3965df12 is already attached to instances: 41c16116-97cf-4394-8c41-2d57d447d422 {{(pid=102148) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jun 24 16:37:18.788759 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-78c2d0dc-ed3a-484e-bacc-eeda0d12b18d tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] 10.222.0.18 "POST /compute/v2.1/servers/41c16116-97cf-4394-8c41-2d57d447d422/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.257146 Jun 24 16:37:18.790212 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 283/543] 10.222.0.18 () {60 vars in 1322 bytes} [Fri Jun 24 16:37:18 2022] POST /compute/v2.1/servers/41c16116-97cf-4394-8c41-2d57d447d422/os-volume_attachments => generated 174 bytes in 260 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 24 16:37:18.802155 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-d20f3514-62fb-4f57-98af-6a69212e4635 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Calling method '>' {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:37:18.803783 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-d20f3514-62fb-4f57-98af-6a69212e4635 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] [instance: 1c690e22-ec9b-423d-9f32-e01ffb3fa4b1] Fetching instance by UUID {{(pid=102148) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:37:18.818849 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-d20f3514-62fb-4f57-98af-6a69212e4635 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:37:18.819581 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-d20f3514-62fb-4f57-98af-6a69212e4635 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:37:18.819867 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-1691e725-1f72-4396-a941-d5d3ab0d45b1 tempest-VolumesSnapshotTestJSON-1294974655 tempest-VolumesSnapshotTestJSON-1294974655-project] 10.222.0.18 "DELETE /compute/v2.1/servers/6eb54c20-7da4-4c74-84fa-bc8e02d41498" status: 204 len: 0 microversion: 2.1 time: 0.272985 Jun 24 16:37:18.820563 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-d20f3514-62fb-4f57-98af-6a69212e4635 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:37:18.821092 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-d20f3514-62fb-4f57-98af-6a69212e4635 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:37:18.822790 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 261/544] 10.222.0.18 () {58 vars in 1238 bytes} [Fri Jun 24 16:37:18 2022] DELETE /compute/v2.1/servers/6eb54c20-7da4-4c74-84fa-bc8e02d41498 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 24 16:37:18.835285 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-7a201e50-3f93-49a2-984a-d554cd344a0b tempest-VolumesSnapshotTestJSON-1294974655 tempest-VolumesSnapshotTestJSON-1294974655-project] Calling method '>' {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:37:18.836972 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-7a201e50-3f93-49a2-984a-d554cd344a0b tempest-VolumesSnapshotTestJSON-1294974655 tempest-VolumesSnapshotTestJSON-1294974655-project] [instance: 6eb54c20-7da4-4c74-84fa-bc8e02d41498] Fetching instance by UUID {{(pid=102149) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:37:18.849566 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-7a201e50-3f93-49a2-984a-d554cd344a0b tempest-VolumesSnapshotTestJSON-1294974655 tempest-VolumesSnapshotTestJSON-1294974655-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:37:18.850344 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-7a201e50-3f93-49a2-984a-d554cd344a0b tempest-VolumesSnapshotTestJSON-1294974655 tempest-VolumesSnapshotTestJSON-1294974655-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:37:18.851736 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-7a201e50-3f93-49a2-984a-d554cd344a0b tempest-VolumesSnapshotTestJSON-1294974655 tempest-VolumesSnapshotTestJSON-1294974655-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:37:18.852765 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-7a201e50-3f93-49a2-984a-d554cd344a0b tempest-VolumesSnapshotTestJSON-1294974655 tempest-VolumesSnapshotTestJSON-1294974655-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:37:19.255794 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-d20f3514-62fb-4f57-98af-6a69212e4635 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c286a3f03048689e5ec552bb89c161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09584de3a4b14c5a90eb9b1c2149d6fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:37:19.265538 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-7a201e50-3f93-49a2-984a-d554cd344a0b tempest-VolumesSnapshotTestJSON-1294974655 tempest-VolumesSnapshotTestJSON-1294974655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7b98bac241449c9a8b14307e4f7993a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0966981b5f4c3fa17c73c0c4b31779', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:37:19.268088 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-d20f3514-62fb-4f57-98af-6a69212e4635 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] 10.222.0.18 "GET /compute/v2.1/servers/1c690e22-ec9b-423d-9f32-e01ffb3fa4b1" status: 200 len: 1507 microversion: 2.1 time: 0.476562 Jun 24 16:37:19.268660 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 284/545] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:37:18 2022] GET /compute/v2.1/servers/1c690e22-ec9b-423d-9f32-e01ffb3fa4b1 => generated 1507 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 16:37:19.273780 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-c92d5a8a-02b2-47aa-a487-3acc18767f27 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Calling method '>' {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:37:19.274290 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-c92d5a8a-02b2-47aa-a487-3acc18767f27 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] [instance: 41c16116-97cf-4394-8c41-2d57d447d422] Fetching instance by UUID {{(pid=102148) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:37:19.278863 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-7a201e50-3f93-49a2-984a-d554cd344a0b tempest-VolumesSnapshotTestJSON-1294974655 tempest-VolumesSnapshotTestJSON-1294974655-project] 10.222.0.18 "GET /compute/v2.1/servers/6eb54c20-7da4-4c74-84fa-bc8e02d41498" status: 200 len: 1513 microversion: 2.1 time: 0.452247 Jun 24 16:37:19.279797 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 262/546] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:37:18 2022] GET /compute/v2.1/servers/6eb54c20-7da4-4c74-84fa-bc8e02d41498 => generated 1513 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 16:37:19.281813 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-c92d5a8a-02b2-47aa-a487-3acc18767f27 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:37:19.282263 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-c92d5a8a-02b2-47aa-a487-3acc18767f27 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:37:19.283069 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-c92d5a8a-02b2-47aa-a487-3acc18767f27 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:37:19.283502 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-c92d5a8a-02b2-47aa-a487-3acc18767f27 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:37:19.599821 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.objects.instance [None req-c92d5a8a-02b2-47aa-a487-3acc18767f27 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lazy-loading 'services' on Instance uuid 41c16116-97cf-4394-8c41-2d57d447d422 {{(pid=102148) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Jun 24 16:37:19.751775 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-c92d5a8a-02b2-47aa-a487-3acc18767f27 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] 10.222.0.18 "DELETE /compute/v2.1/servers/41c16116-97cf-4394-8c41-2d57d447d422/os-volume_attachments/bef85cc0-4490-453a-aeeb-011c3965df12" status: 202 len: 0 microversion: 2.1 time: 0.481840 Jun 24 16:37:19.752588 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 285/547] 10.222.0.18 () {58 vars in 1415 bytes} [Fri Jun 24 16:37:19 2022] DELETE /compute/v2.1/servers/41c16116-97cf-4394-8c41-2d57d447d422/os-volume_attachments/bef85cc0-4490-453a-aeeb-011c3965df12 => generated 0 bytes in 483 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 24 16:37:19.761139 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-64b5a47b-f00e-4d2d-89c6-a79d8cfa1ebf tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Calling method '>' {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:37:19.762256 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-64b5a47b-f00e-4d2d-89c6-a79d8cfa1ebf tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] [instance: 41c16116-97cf-4394-8c41-2d57d447d422] Fetching instance by UUID {{(pid=102149) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:37:19.771186 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-64b5a47b-f00e-4d2d-89c6-a79d8cfa1ebf tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:37:19.771798 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-64b5a47b-f00e-4d2d-89c6-a79d8cfa1ebf tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:37:19.772576 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-64b5a47b-f00e-4d2d-89c6-a79d8cfa1ebf tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:37:19.773011 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-64b5a47b-f00e-4d2d-89c6-a79d8cfa1ebf tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:37:19.845912 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-64b5a47b-f00e-4d2d-89c6-a79d8cfa1ebf tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] 10.222.0.18 "GET /compute/v2.1/servers/41c16116-97cf-4394-8c41-2d57d447d422/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.088921 Jun 24 16:37:19.846631 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 263/548] 10.222.0.18 () {58 vars in 1301 bytes} [Fri Jun 24 16:37:19 2022] GET /compute/v2.1/servers/41c16116-97cf-4394-8c41-2d57d447d422/os-volume_attachments => generated 197 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 16:37:20.290670 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-6dc563be-4a52-4d1f-8e2a-9302105f826b tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Calling method '>' {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:37:20.291416 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-6dc563be-4a52-4d1f-8e2a-9302105f826b tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] [instance: 1c690e22-ec9b-423d-9f32-e01ffb3fa4b1] Fetching instance by UUID {{(pid=102148) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:37:20.300541 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-6dc563be-4a52-4d1f-8e2a-9302105f826b tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:37:20.301072 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-6dc563be-4a52-4d1f-8e2a-9302105f826b tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:37:20.302569 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-6dc563be-4a52-4d1f-8e2a-9302105f826b tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:37:20.303019 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-6dc563be-4a52-4d1f-8e2a-9302105f826b tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:37:20.307259 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-b4176bf5-d46b-4bd2-870c-09c8e3fda478 tempest-VolumesSnapshotTestJSON-1294974655 tempest-VolumesSnapshotTestJSON-1294974655-project] Calling method '>' {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:37:20.308123 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-b4176bf5-d46b-4bd2-870c-09c8e3fda478 tempest-VolumesSnapshotTestJSON-1294974655 tempest-VolumesSnapshotTestJSON-1294974655-project] [instance: 6eb54c20-7da4-4c74-84fa-bc8e02d41498] Fetching instance by UUID {{(pid=102149) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:37:20.319428 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-b4176bf5-d46b-4bd2-870c-09c8e3fda478 tempest-VolumesSnapshotTestJSON-1294974655 tempest-VolumesSnapshotTestJSON-1294974655-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:37:20.320265 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-b4176bf5-d46b-4bd2-870c-09c8e3fda478 tempest-VolumesSnapshotTestJSON-1294974655 tempest-VolumesSnapshotTestJSON-1294974655-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:37:20.321528 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-b4176bf5-d46b-4bd2-870c-09c8e3fda478 tempest-VolumesSnapshotTestJSON-1294974655 tempest-VolumesSnapshotTestJSON-1294974655-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:37:20.322210 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-b4176bf5-d46b-4bd2-870c-09c8e3fda478 tempest-VolumesSnapshotTestJSON-1294974655 tempest-VolumesSnapshotTestJSON-1294974655-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:37:21.008333 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-6dc563be-4a52-4d1f-8e2a-9302105f826b tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c286a3f03048689e5ec552bb89c161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09584de3a4b14c5a90eb9b1c2149d6fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:37:21.019731 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-6dc563be-4a52-4d1f-8e2a-9302105f826b tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] 10.222.0.18 "GET /compute/v2.1/servers/1c690e22-ec9b-423d-9f32-e01ffb3fa4b1" status: 200 len: 1507 microversion: 2.1 time: 0.736180 Jun 24 16:37:21.021193 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 286/549] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:37:20 2022] GET /compute/v2.1/servers/1c690e22-ec9b-423d-9f32-e01ffb3fa4b1 => generated 1507 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 16:37:21.022618 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-b4176bf5-d46b-4bd2-870c-09c8e3fda478 tempest-VolumesSnapshotTestJSON-1294974655 tempest-VolumesSnapshotTestJSON-1294974655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7b98bac241449c9a8b14307e4f7993a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0966981b5f4c3fa17c73c0c4b31779', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:37:21.026497 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-f1f23f4a-8cc9-49a0-b041-7ed0b625696c tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Calling method '>' {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:37:21.027877 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-f1f23f4a-8cc9-49a0-b041-7ed0b625696c tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] [instance: 41c16116-97cf-4394-8c41-2d57d447d422] Fetching instance by UUID {{(pid=102148) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:37:21.035682 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-f1f23f4a-8cc9-49a0-b041-7ed0b625696c tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:37:21.037106 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-f1f23f4a-8cc9-49a0-b041-7ed0b625696c tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:37:21.038100 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-f1f23f4a-8cc9-49a0-b041-7ed0b625696c tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:37:21.038768 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-f1f23f4a-8cc9-49a0-b041-7ed0b625696c tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:37:21.043485 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-b4176bf5-d46b-4bd2-870c-09c8e3fda478 tempest-VolumesSnapshotTestJSON-1294974655 tempest-VolumesSnapshotTestJSON-1294974655-project] 10.222.0.18 "GET /compute/v2.1/servers/6eb54c20-7da4-4c74-84fa-bc8e02d41498" status: 200 len: 1513 microversion: 2.1 time: 0.744106 Jun 24 16:37:21.046539 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 264/550] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:37:20 2022] GET /compute/v2.1/servers/6eb54c20-7da4-4c74-84fa-bc8e02d41498 => generated 1513 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 16:37:21.123575 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-f1f23f4a-8cc9-49a0-b041-7ed0b625696c tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] 10.222.0.18 "GET /compute/v2.1/servers/41c16116-97cf-4394-8c41-2d57d447d422/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.100715 Jun 24 16:37:21.124561 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 287/551] 10.222.0.18 () {58 vars in 1301 bytes} [Fri Jun 24 16:37:21 2022] GET /compute/v2.1/servers/41c16116-97cf-4394-8c41-2d57d447d422/os-volume_attachments => generated 25 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 24 16:37:21.268002 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-15675e14-b93a-45a6-9e0b-f72528862c11 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Calling method '>' {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:37:21.268495 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-15675e14-b93a-45a6-9e0b-f72528862c11 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] [instance: 41c16116-97cf-4394-8c41-2d57d447d422] Fetching instance by UUID {{(pid=102149) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:37:21.276751 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-15675e14-b93a-45a6-9e0b-f72528862c11 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:37:21.277243 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-15675e14-b93a-45a6-9e0b-f72528862c11 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:37:21.278073 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-15675e14-b93a-45a6-9e0b-f72528862c11 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:37:21.278594 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-15675e14-b93a-45a6-9e0b-f72528862c11 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:37:21.344891 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-15675e14-b93a-45a6-9e0b-f72528862c11 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] [instance: 41c16116-97cf-4394-8c41-2d57d447d422] Going to try to terminate instance {{(pid=102149) delete /opt/stack/nova/nova/compute/api.py:2562}} Jun 24 16:37:21.521356 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-15675e14-b93a-45a6-9e0b-f72528862c11 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] 10.222.0.18 "DELETE /compute/v2.1/servers/41c16116-97cf-4394-8c41-2d57d447d422" status: 204 len: 0 microversion: 2.1 time: 0.254703 Jun 24 16:37:21.525906 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 265/552] 10.222.0.18 () {58 vars in 1238 bytes} [Fri Jun 24 16:37:21 2022] DELETE /compute/v2.1/servers/41c16116-97cf-4394-8c41-2d57d447d422 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 24 16:37:21.536857 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-11f53502-50a5-4da4-9f86-ef6a36cc858c tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Calling method '>' {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:37:21.538393 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-11f53502-50a5-4da4-9f86-ef6a36cc858c tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] [instance: 41c16116-97cf-4394-8c41-2d57d447d422] Fetching instance by UUID {{(pid=102148) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:37:21.551114 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-11f53502-50a5-4da4-9f86-ef6a36cc858c tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:37:21.552187 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-11f53502-50a5-4da4-9f86-ef6a36cc858c tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:37:21.553261 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-11f53502-50a5-4da4-9f86-ef6a36cc858c tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:37:21.553897 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-11f53502-50a5-4da4-9f86-ef6a36cc858c tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:37:21.788810 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [req-36d251a6-2fbf-4861-8502-e0c3b0d6c2a4 req-ba94fc7d-8cde-4f29-818f-99ee2c535014 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1c690e22-ec9b-423d-9f32-e01ffb3fa4b1", "name": "network-vif-deleted", "tag": "05c13379-1583-4cb1-b0df-784284e184a4"}]} {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 16:37:21.791769 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 24 16:37:21.791769 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: warnings.warn(msg) Jun 24 16:37:21.808415 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [req-36d251a6-2fbf-4861-8502-e0c3b0d6c2a4 req-ba94fc7d-8cde-4f29-818f-99ee2c535014 service nova] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:37:21.809206 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [req-36d251a6-2fbf-4861-8502-e0c3b0d6c2a4 req-ba94fc7d-8cde-4f29-818f-99ee2c535014 service nova] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:37:21.837793 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.compute.server_external_events [req-36d251a6-2fbf-4861-8502-e0c3b0d6c2a4 req-ba94fc7d-8cde-4f29-818f-99ee2c535014 service nova] Creating event network-vif-deleted:05c13379-1583-4cb1-b0df-784284e184a4 for instance 1c690e22-ec9b-423d-9f32-e01ffb3fa4b1 on hv-cinder-84718 Jun 24 16:37:21.844218 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [req-36d251a6-2fbf-4861-8502-e0c3b0d6c2a4 req-ba94fc7d-8cde-4f29-818f-99ee2c535014 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063980 Jun 24 16:37:21.845495 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 266/553] 10.222.0.18 () {64 vars in 1317 bytes} [Fri Jun 24 16:37:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 16:37:21.954651 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-11f53502-50a5-4da4-9f86-ef6a36cc858c tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '499faf87cf8c41ae823b2566e4c2d8ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606ba814a2d8408ab0856d539ca79b4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:37:21.988036 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-11f53502-50a5-4da4-9f86-ef6a36cc858c tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] 10.222.0.18 "GET /compute/v2.1/servers/41c16116-97cf-4394-8c41-2d57d447d422" status: 200 len: 1683 microversion: 2.1 time: 0.456859 Jun 24 16:37:21.989870 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 288/554] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:37:21 2022] GET /compute/v2.1/servers/41c16116-97cf-4394-8c41-2d57d447d422 => generated 1683 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 16:37:22.043877 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-812ebf86-0b41-4ba3-b123-247cb7944654 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Calling method '>' {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:37:22.046240 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-812ebf86-0b41-4ba3-b123-247cb7944654 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] [instance: 1c690e22-ec9b-423d-9f32-e01ffb3fa4b1] Fetching instance by UUID {{(pid=102149) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:37:22.064264 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-812ebf86-0b41-4ba3-b123-247cb7944654 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:37:22.065644 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-812ebf86-0b41-4ba3-b123-247cb7944654 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:37:22.067712 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-812ebf86-0b41-4ba3-b123-247cb7944654 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:37:22.068921 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-812ebf86-0b41-4ba3-b123-247cb7944654 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:37:22.076283 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-60413179-2416-400c-8630-0e57088fcfe4 tempest-VolumesSnapshotTestJSON-1294974655 tempest-VolumesSnapshotTestJSON-1294974655-project] Calling method '>' {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:37:22.078818 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-60413179-2416-400c-8630-0e57088fcfe4 tempest-VolumesSnapshotTestJSON-1294974655 tempest-VolumesSnapshotTestJSON-1294974655-project] [instance: 6eb54c20-7da4-4c74-84fa-bc8e02d41498] Fetching instance by UUID {{(pid=102148) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:37:22.098081 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-60413179-2416-400c-8630-0e57088fcfe4 tempest-VolumesSnapshotTestJSON-1294974655 tempest-VolumesSnapshotTestJSON-1294974655-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:37:22.099504 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-60413179-2416-400c-8630-0e57088fcfe4 tempest-VolumesSnapshotTestJSON-1294974655 tempest-VolumesSnapshotTestJSON-1294974655-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:37:22.102085 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-60413179-2416-400c-8630-0e57088fcfe4 tempest-VolumesSnapshotTestJSON-1294974655 tempest-VolumesSnapshotTestJSON-1294974655-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:37:22.103764 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-60413179-2416-400c-8630-0e57088fcfe4 tempest-VolumesSnapshotTestJSON-1294974655 tempest-VolumesSnapshotTestJSON-1294974655-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:37:22.187637 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-812ebf86-0b41-4ba3-b123-247cb7944654 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:37:22.188038 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-812ebf86-0b41-4ba3-b123-247cb7944654 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:37:22.188525 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.objects.instance [None req-812ebf86-0b41-4ba3-b123-247cb7944654 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lazy-loading 'fault' on Instance uuid 1c690e22-ec9b-423d-9f32-e01ffb3fa4b1 {{(pid=102149) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Jun 24 16:37:22.338153 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-812ebf86-0b41-4ba3-b123-247cb7944654 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c286a3f03048689e5ec552bb89c161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09584de3a4b14c5a90eb9b1c2149d6fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:37:22.348305 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-812ebf86-0b41-4ba3-b123-247cb7944654 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] 10.222.0.18 "GET /compute/v2.1/servers/1c690e22-ec9b-423d-9f32-e01ffb3fa4b1" status: 200 len: 1311 microversion: 2.1 time: 0.313345 Jun 24 16:37:22.357925 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 267/555] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:37:22 2022] GET /compute/v2.1/servers/1c690e22-ec9b-423d-9f32-e01ffb3fa4b1 => generated 1311 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 16:37:22.373573 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-60413179-2416-400c-8630-0e57088fcfe4 tempest-VolumesSnapshotTestJSON-1294974655 tempest-VolumesSnapshotTestJSON-1294974655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7b98bac241449c9a8b14307e4f7993a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0966981b5f4c3fa17c73c0c4b31779', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:37:22.389202 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-60413179-2416-400c-8630-0e57088fcfe4 tempest-VolumesSnapshotTestJSON-1294974655 tempest-VolumesSnapshotTestJSON-1294974655-project] 10.222.0.18 "GET /compute/v2.1/servers/6eb54c20-7da4-4c74-84fa-bc8e02d41498" status: 200 len: 1471 microversion: 2.1 time: 0.321486 Jun 24 16:37:22.390070 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 289/556] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:37:22 2022] GET /compute/v2.1/servers/6eb54c20-7da4-4c74-84fa-bc8e02d41498 => generated 1471 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 16:37:22.711546 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [req-fa6cf86e-72be-4c67-ad29-0e409c0d8102 req-e2299785-3b46-4161-b6f4-609ee1a1f577 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6eb54c20-7da4-4c74-84fa-bc8e02d41498", "name": "network-vif-deleted", "tag": "d95976e1-d2cd-4d86-9f01-6e00d8d76035"}]} {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 16:37:22.714492 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 24 16:37:22.714492 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: warnings.warn(msg) Jun 24 16:37:22.731137 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [req-fa6cf86e-72be-4c67-ad29-0e409c0d8102 req-e2299785-3b46-4161-b6f4-609ee1a1f577 service nova] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:37:22.732550 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [req-fa6cf86e-72be-4c67-ad29-0e409c0d8102 req-e2299785-3b46-4161-b6f4-609ee1a1f577 service nova] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:37:22.757147 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.compute.server_external_events [req-fa6cf86e-72be-4c67-ad29-0e409c0d8102 req-e2299785-3b46-4161-b6f4-609ee1a1f577 service nova] Creating event network-vif-deleted:d95976e1-d2cd-4d86-9f01-6e00d8d76035 for instance 6eb54c20-7da4-4c74-84fa-bc8e02d41498 on hv-cinder-84718 Jun 24 16:37:22.762113 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [req-fa6cf86e-72be-4c67-ad29-0e409c0d8102 req-e2299785-3b46-4161-b6f4-609ee1a1f577 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.165680 Jun 24 16:37:22.763188 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 268/557] 10.222.0.18 () {64 vars in 1317 bytes} [Fri Jun 24 16:37:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 16:37:23.016428 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-ee433b62-d57e-4cad-92a3-a7189c9f81b9 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Calling method '>' {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:37:23.017056 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-ee433b62-d57e-4cad-92a3-a7189c9f81b9 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] [instance: 41c16116-97cf-4394-8c41-2d57d447d422] Fetching instance by UUID {{(pid=102148) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:37:23.025404 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-ee433b62-d57e-4cad-92a3-a7189c9f81b9 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:37:23.025849 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-ee433b62-d57e-4cad-92a3-a7189c9f81b9 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:37:23.026629 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-ee433b62-d57e-4cad-92a3-a7189c9f81b9 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:37:23.027096 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-ee433b62-d57e-4cad-92a3-a7189c9f81b9 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:37:23.303103 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-ee433b62-d57e-4cad-92a3-a7189c9f81b9 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '499faf87cf8c41ae823b2566e4c2d8ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606ba814a2d8408ab0856d539ca79b4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:37:23.319004 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-ee433b62-d57e-4cad-92a3-a7189c9f81b9 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] 10.222.0.18 "GET /compute/v2.1/servers/41c16116-97cf-4394-8c41-2d57d447d422" status: 200 len: 1683 microversion: 2.1 time: 0.306770 Jun 24 16:37:23.320027 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 290/558] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:37:23 2022] GET /compute/v2.1/servers/41c16116-97cf-4394-8c41-2d57d447d422 => generated 1683 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 16:37:23.371315 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-13ff42ec-52ff-4ad1-9508-663a22f918f5 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Calling method '>' {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:37:23.373687 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-13ff42ec-52ff-4ad1-9508-663a22f918f5 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] [instance: 1c690e22-ec9b-423d-9f32-e01ffb3fa4b1] Fetching instance by UUID {{(pid=102149) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:37:23.395291 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-13ff42ec-52ff-4ad1-9508-663a22f918f5 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:37:23.396789 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-13ff42ec-52ff-4ad1-9508-663a22f918f5 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:37:23.401615 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-13ff42ec-52ff-4ad1-9508-663a22f918f5 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:37:23.402858 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-13ff42ec-52ff-4ad1-9508-663a22f918f5 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:37:23.414274 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-abf1e21e-dc43-4c25-a377-18b0d440dec5 tempest-VolumesSnapshotTestJSON-1294974655 tempest-VolumesSnapshotTestJSON-1294974655-project] Calling method '>' {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:37:23.415522 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-abf1e21e-dc43-4c25-a377-18b0d440dec5 tempest-VolumesSnapshotTestJSON-1294974655 tempest-VolumesSnapshotTestJSON-1294974655-project] [instance: 6eb54c20-7da4-4c74-84fa-bc8e02d41498] Fetching instance by UUID {{(pid=102148) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:37:23.430122 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-abf1e21e-dc43-4c25-a377-18b0d440dec5 tempest-VolumesSnapshotTestJSON-1294974655 tempest-VolumesSnapshotTestJSON-1294974655-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:37:23.430945 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-abf1e21e-dc43-4c25-a377-18b0d440dec5 tempest-VolumesSnapshotTestJSON-1294974655 tempest-VolumesSnapshotTestJSON-1294974655-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:37:23.432409 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-abf1e21e-dc43-4c25-a377-18b0d440dec5 tempest-VolumesSnapshotTestJSON-1294974655 tempest-VolumesSnapshotTestJSON-1294974655-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:37:23.433245 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-abf1e21e-dc43-4c25-a377-18b0d440dec5 tempest-VolumesSnapshotTestJSON-1294974655 tempest-VolumesSnapshotTestJSON-1294974655-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:37:23.524704 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-abf1e21e-dc43-4c25-a377-18b0d440dec5 tempest-VolumesSnapshotTestJSON-1294974655 tempest-VolumesSnapshotTestJSON-1294974655-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:37:23.525251 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-abf1e21e-dc43-4c25-a377-18b0d440dec5 tempest-VolumesSnapshotTestJSON-1294974655 tempest-VolumesSnapshotTestJSON-1294974655-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:37:23.526242 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.objects.instance [None req-abf1e21e-dc43-4c25-a377-18b0d440dec5 tempest-VolumesSnapshotTestJSON-1294974655 tempest-VolumesSnapshotTestJSON-1294974655-project] Lazy-loading 'fault' on Instance uuid 6eb54c20-7da4-4c74-84fa-bc8e02d41498 {{(pid=102148) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Jun 24 16:37:23.530752 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.wsgi [None req-13ff42ec-52ff-4ad1-9508-663a22f918f5 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] HTTP exception thrown: Instance 1c690e22-ec9b-423d-9f32-e01ffb3fa4b1 could not be found. Jun 24 16:37:23.531996 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-13ff42ec-52ff-4ad1-9508-663a22f918f5 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Returning 404 to user: Instance 1c690e22-ec9b-423d-9f32-e01ffb3fa4b1 could not be found. {{(pid=102149) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jun 24 16:37:23.533609 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-13ff42ec-52ff-4ad1-9508-663a22f918f5 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] 10.222.0.18 "GET /compute/v2.1/servers/1c690e22-ec9b-423d-9f32-e01ffb3fa4b1" status: 404 len: 111 microversion: 2.1 time: 0.171883 Jun 24 16:37:23.534797 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 269/559] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:37:23 2022] GET /compute/v2.1/servers/1c690e22-ec9b-423d-9f32-e01ffb3fa4b1 => generated 111 bytes in 174 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 24 16:37:23.547884 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-600a5daa-696c-43b8-86ed-7cee34973794 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Calling method '>' {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:37:23.548939 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-600a5daa-696c-43b8-86ed-7cee34973794 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] [instance: 4eb74274-8b99-455f-8f03-681fbea6b6e0] Fetching instance by UUID {{(pid=102149) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:37:23.563137 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-600a5daa-696c-43b8-86ed-7cee34973794 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:37:23.564121 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-600a5daa-696c-43b8-86ed-7cee34973794 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:37:23.565638 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-600a5daa-696c-43b8-86ed-7cee34973794 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:37:23.566532 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-600a5daa-696c-43b8-86ed-7cee34973794 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:37:23.644696 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-abf1e21e-dc43-4c25-a377-18b0d440dec5 tempest-VolumesSnapshotTestJSON-1294974655 tempest-VolumesSnapshotTestJSON-1294974655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7b98bac241449c9a8b14307e4f7993a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0966981b5f4c3fa17c73c0c4b31779', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:37:23.658854 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-abf1e21e-dc43-4c25-a377-18b0d440dec5 tempest-VolumesSnapshotTestJSON-1294974655 tempest-VolumesSnapshotTestJSON-1294974655-project] 10.222.0.18 "GET /compute/v2.1/servers/6eb54c20-7da4-4c74-84fa-bc8e02d41498" status: 200 len: 1308 microversion: 2.1 time: 0.252064 Jun 24 16:37:23.670808 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 291/560] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:37:23 2022] GET /compute/v2.1/servers/6eb54c20-7da4-4c74-84fa-bc8e02d41498 => generated 1308 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 16:37:23.862117 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-600a5daa-696c-43b8-86ed-7cee34973794 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] [instance: 4eb74274-8b99-455f-8f03-681fbea6b6e0] Going to try to terminate instance {{(pid=102149) delete /opt/stack/nova/nova/compute/api.py:2562}} Jun 24 16:37:24.004029 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-600a5daa-696c-43b8-86ed-7cee34973794 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] 10.222.0.18 "DELETE /compute/v2.1/servers/4eb74274-8b99-455f-8f03-681fbea6b6e0" status: 204 len: 0 microversion: 2.1 time: 0.464041 Jun 24 16:37:24.008758 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 270/561] 10.222.0.18 () {58 vars in 1238 bytes} [Fri Jun 24 16:37:23 2022] DELETE /compute/v2.1/servers/4eb74274-8b99-455f-8f03-681fbea6b6e0 => generated 0 bytes in 466 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 24 16:37:24.018939 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-3e1e04fe-5845-4151-98f4-8c00015192f0 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Calling method '>' {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:37:24.019378 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-3e1e04fe-5845-4151-98f4-8c00015192f0 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] [instance: 4eb74274-8b99-455f-8f03-681fbea6b6e0] Fetching instance by UUID {{(pid=102148) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:37:24.034920 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-3e1e04fe-5845-4151-98f4-8c00015192f0 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:37:24.035751 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-3e1e04fe-5845-4151-98f4-8c00015192f0 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:37:24.037989 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-3e1e04fe-5845-4151-98f4-8c00015192f0 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:37:24.038815 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-3e1e04fe-5845-4151-98f4-8c00015192f0 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:37:24.358307 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-9db4b445-e066-4c96-9f36-34163eaeaa4a tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Calling method '>' {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:37:24.360011 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-9db4b445-e066-4c96-9f36-34163eaeaa4a tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] [instance: 41c16116-97cf-4394-8c41-2d57d447d422] Fetching instance by UUID {{(pid=102149) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:37:24.394443 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-9db4b445-e066-4c96-9f36-34163eaeaa4a tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:37:24.396661 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-9db4b445-e066-4c96-9f36-34163eaeaa4a tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:37:24.399329 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-9db4b445-e066-4c96-9f36-34163eaeaa4a tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:37:24.400523 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-9db4b445-e066-4c96-9f36-34163eaeaa4a tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:37:24.463918 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-3e1e04fe-5845-4151-98f4-8c00015192f0 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c286a3f03048689e5ec552bb89c161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09584de3a4b14c5a90eb9b1c2149d6fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:37:24.475300 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-3e1e04fe-5845-4151-98f4-8c00015192f0 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] 10.222.0.18 "GET /compute/v2.1/servers/4eb74274-8b99-455f-8f03-681fbea6b6e0" status: 200 len: 1522 microversion: 2.1 time: 0.464585 Jun 24 16:37:24.476627 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 292/562] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:37:24 2022] GET /compute/v2.1/servers/4eb74274-8b99-455f-8f03-681fbea6b6e0 => generated 1522 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 16:37:24.689815 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-263d9bc7-0aad-48f1-821d-ebb641dd38fb tempest-VolumesSnapshotTestJSON-1294974655 tempest-VolumesSnapshotTestJSON-1294974655-project] Calling method '>' {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:37:24.690951 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-263d9bc7-0aad-48f1-821d-ebb641dd38fb tempest-VolumesSnapshotTestJSON-1294974655 tempest-VolumesSnapshotTestJSON-1294974655-project] [instance: 6eb54c20-7da4-4c74-84fa-bc8e02d41498] Fetching instance by UUID {{(pid=102148) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:37:24.703959 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-263d9bc7-0aad-48f1-821d-ebb641dd38fb tempest-VolumesSnapshotTestJSON-1294974655 tempest-VolumesSnapshotTestJSON-1294974655-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:37:24.706020 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-263d9bc7-0aad-48f1-821d-ebb641dd38fb tempest-VolumesSnapshotTestJSON-1294974655 tempest-VolumesSnapshotTestJSON-1294974655-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:37:24.707460 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-263d9bc7-0aad-48f1-821d-ebb641dd38fb tempest-VolumesSnapshotTestJSON-1294974655 tempest-VolumesSnapshotTestJSON-1294974655-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:37:24.708772 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-263d9bc7-0aad-48f1-821d-ebb641dd38fb tempest-VolumesSnapshotTestJSON-1294974655 tempest-VolumesSnapshotTestJSON-1294974655-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:37:24.739606 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-9db4b445-e066-4c96-9f36-34163eaeaa4a tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '499faf87cf8c41ae823b2566e4c2d8ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606ba814a2d8408ab0856d539ca79b4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:37:24.750436 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-9db4b445-e066-4c96-9f36-34163eaeaa4a tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] 10.222.0.18 "GET /compute/v2.1/servers/41c16116-97cf-4394-8c41-2d57d447d422" status: 200 len: 1683 microversion: 2.1 time: 0.408249 Jun 24 16:37:24.751906 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 271/563] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:37:24 2022] GET /compute/v2.1/servers/41c16116-97cf-4394-8c41-2d57d447d422 => generated 1683 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 16:37:24.806119 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.wsgi [None req-263d9bc7-0aad-48f1-821d-ebb641dd38fb tempest-VolumesSnapshotTestJSON-1294974655 tempest-VolumesSnapshotTestJSON-1294974655-project] HTTP exception thrown: Instance 6eb54c20-7da4-4c74-84fa-bc8e02d41498 could not be found. Jun 24 16:37:24.806749 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-263d9bc7-0aad-48f1-821d-ebb641dd38fb tempest-VolumesSnapshotTestJSON-1294974655 tempest-VolumesSnapshotTestJSON-1294974655-project] Returning 404 to user: Instance 6eb54c20-7da4-4c74-84fa-bc8e02d41498 could not be found. {{(pid=102148) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jun 24 16:37:24.807605 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-263d9bc7-0aad-48f1-821d-ebb641dd38fb tempest-VolumesSnapshotTestJSON-1294974655 tempest-VolumesSnapshotTestJSON-1294974655-project] 10.222.0.18 "GET /compute/v2.1/servers/6eb54c20-7da4-4c74-84fa-bc8e02d41498" status: 404 len: 111 microversion: 2.1 time: 0.125135 Jun 24 16:37:24.808147 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 293/564] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:37:24 2022] GET /compute/v2.1/servers/6eb54c20-7da4-4c74-84fa-bc8e02d41498 => generated 111 bytes in 127 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 24 16:37:25.486534 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [req-a12711eb-f3ca-49e1-999f-b3979e003722 req-90ac469e-79f6-4c8c-bae3-9f73ab991f08 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "41c16116-97cf-4394-8c41-2d57d447d422", "name": "network-vif-deleted", "tag": "6ccb72c8-72c5-4467-a284-d1c79d49c232"}]} {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 16:37:25.491032 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 24 16:37:25.491032 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: warnings.warn(msg) Jun 24 16:37:25.497436 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-70a3f6b5-fbfa-4fd5-af2c-b8effd36b9eb tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Calling method '>' {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:37:25.498483 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-70a3f6b5-fbfa-4fd5-af2c-b8effd36b9eb tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] [instance: 4eb74274-8b99-455f-8f03-681fbea6b6e0] Fetching instance by UUID {{(pid=102148) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:37:25.506186 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [req-a12711eb-f3ca-49e1-999f-b3979e003722 req-90ac469e-79f6-4c8c-bae3-9f73ab991f08 service nova] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:37:25.507267 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [req-a12711eb-f3ca-49e1-999f-b3979e003722 req-90ac469e-79f6-4c8c-bae3-9f73ab991f08 service nova] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:37:25.524744 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-70a3f6b5-fbfa-4fd5-af2c-b8effd36b9eb tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:37:25.525465 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-70a3f6b5-fbfa-4fd5-af2c-b8effd36b9eb tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:37:25.526968 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-70a3f6b5-fbfa-4fd5-af2c-b8effd36b9eb tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:37:25.537763 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.compute.server_external_events [req-a12711eb-f3ca-49e1-999f-b3979e003722 req-90ac469e-79f6-4c8c-bae3-9f73ab991f08 service nova] Creating event network-vif-deleted:6ccb72c8-72c5-4467-a284-d1c79d49c232 for instance 41c16116-97cf-4394-8c41-2d57d447d422 on hv-cinder-84718 Jun 24 16:37:25.540159 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-70a3f6b5-fbfa-4fd5-af2c-b8effd36b9eb tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:37:25.543769 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [req-a12711eb-f3ca-49e1-999f-b3979e003722 req-90ac469e-79f6-4c8c-bae3-9f73ab991f08 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063937 Jun 24 16:37:25.544540 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 272/565] 10.222.0.18 () {64 vars in 1317 bytes} [Fri Jun 24 16:37:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 16:37:25.770874 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-073690d6-b5c2-4307-8739-7376a8c2b5af tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Calling method '>' {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:37:25.771879 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-073690d6-b5c2-4307-8739-7376a8c2b5af tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] [instance: 41c16116-97cf-4394-8c41-2d57d447d422] Fetching instance by UUID {{(pid=102149) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:37:25.786066 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-073690d6-b5c2-4307-8739-7376a8c2b5af tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:37:25.786882 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-073690d6-b5c2-4307-8739-7376a8c2b5af tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:37:25.788248 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-073690d6-b5c2-4307-8739-7376a8c2b5af tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:37:25.789015 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-073690d6-b5c2-4307-8739-7376a8c2b5af tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:37:25.878734 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-70a3f6b5-fbfa-4fd5-af2c-b8effd36b9eb tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c286a3f03048689e5ec552bb89c161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09584de3a4b14c5a90eb9b1c2149d6fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:37:25.896014 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-70a3f6b5-fbfa-4fd5-af2c-b8effd36b9eb tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] 10.222.0.18 "GET /compute/v2.1/servers/4eb74274-8b99-455f-8f03-681fbea6b6e0" status: 200 len: 1522 microversion: 2.1 time: 0.405112 Jun 24 16:37:25.897303 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 294/566] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:37:25 2022] GET /compute/v2.1/servers/4eb74274-8b99-455f-8f03-681fbea6b6e0 => generated 1522 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 16:37:25.931133 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-073690d6-b5c2-4307-8739-7376a8c2b5af tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:37:25.931919 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-073690d6-b5c2-4307-8739-7376a8c2b5af tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:37:25.932712 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.objects.instance [None req-073690d6-b5c2-4307-8739-7376a8c2b5af tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lazy-loading 'fault' on Instance uuid 41c16116-97cf-4394-8c41-2d57d447d422 {{(pid=102149) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Jun 24 16:37:26.018155 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-073690d6-b5c2-4307-8739-7376a8c2b5af tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '499faf87cf8c41ae823b2566e4c2d8ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606ba814a2d8408ab0856d539ca79b4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:37:26.026717 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-073690d6-b5c2-4307-8739-7376a8c2b5af tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] 10.222.0.18 "GET /compute/v2.1/servers/41c16116-97cf-4394-8c41-2d57d447d422" status: 200 len: 1332 microversion: 2.1 time: 0.260632 Jun 24 16:37:26.027279 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 273/567] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:37:25 2022] GET /compute/v2.1/servers/41c16116-97cf-4394-8c41-2d57d447d422 => generated 1332 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 16:37:26.922283 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-172e1047-dba2-4ec4-92aa-400997382f30 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Calling method '>' {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:37:26.923116 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-172e1047-dba2-4ec4-92aa-400997382f30 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] [instance: 4eb74274-8b99-455f-8f03-681fbea6b6e0] Fetching instance by UUID {{(pid=102148) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:37:26.933170 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-172e1047-dba2-4ec4-92aa-400997382f30 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:37:26.934141 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-172e1047-dba2-4ec4-92aa-400997382f30 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:37:26.935786 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-172e1047-dba2-4ec4-92aa-400997382f30 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:37:26.936904 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-172e1047-dba2-4ec4-92aa-400997382f30 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:37:27.049179 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-85b2f371-b317-4b36-8e7a-c753154f3eef tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Calling method '>' {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:37:27.052015 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-85b2f371-b317-4b36-8e7a-c753154f3eef tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] [instance: 41c16116-97cf-4394-8c41-2d57d447d422] Fetching instance by UUID {{(pid=102149) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:37:27.065681 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-85b2f371-b317-4b36-8e7a-c753154f3eef tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:37:27.066734 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-85b2f371-b317-4b36-8e7a-c753154f3eef tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:37:27.068312 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-85b2f371-b317-4b36-8e7a-c753154f3eef tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:37:27.068936 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-85b2f371-b317-4b36-8e7a-c753154f3eef tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:37:27.179285 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.wsgi [None req-85b2f371-b317-4b36-8e7a-c753154f3eef tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] HTTP exception thrown: Instance 41c16116-97cf-4394-8c41-2d57d447d422 could not be found. Jun 24 16:37:27.180475 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-85b2f371-b317-4b36-8e7a-c753154f3eef tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Returning 404 to user: Instance 41c16116-97cf-4394-8c41-2d57d447d422 could not be found. {{(pid=102149) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jun 24 16:37:27.181728 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-85b2f371-b317-4b36-8e7a-c753154f3eef tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] 10.222.0.18 "GET /compute/v2.1/servers/41c16116-97cf-4394-8c41-2d57d447d422" status: 404 len: 111 microversion: 2.1 time: 0.139583 Jun 24 16:37:27.182711 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 274/568] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:37:27 2022] GET /compute/v2.1/servers/41c16116-97cf-4394-8c41-2d57d447d422 => generated 111 bytes in 142 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 16:37:27.197320 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-771f167b-bc15-4ffd-abdd-c1754948a029 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Calling method '.version_select at 0x7f1ae8429c10>' {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:37:27.228530 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-771f167b-bc15-4ffd-abdd-c1754948a029 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1633146838" status: 202 len: 0 microversion: 2.1 time: 0.038375 Jun 24 16:37:27.230582 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 275/569] 10.222.0.18 () {58 vars in 1220 bytes} [Fri Jun 24 16:37:27 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1633146838 => generated 0 bytes in 42 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 24 16:37:27.402438 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-172e1047-dba2-4ec4-92aa-400997382f30 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c286a3f03048689e5ec552bb89c161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09584de3a4b14c5a90eb9b1c2149d6fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:37:27.424216 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-172e1047-dba2-4ec4-92aa-400997382f30 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] 10.222.0.18 "GET /compute/v2.1/servers/4eb74274-8b99-455f-8f03-681fbea6b6e0" status: 200 len: 1522 microversion: 2.1 time: 0.505500 Jun 24 16:37:27.425958 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 295/570] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:37:26 2022] GET /compute/v2.1/servers/4eb74274-8b99-455f-8f03-681fbea6b6e0 => generated 1522 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 16:37:27.958681 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [req-be272b9d-a6ca-48c7-8c02-84723fb6130f req-ccf78539-1890-4cda-aff8-753f45943532 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4eb74274-8b99-455f-8f03-681fbea6b6e0", "name": "network-vif-deleted", "tag": "11484e4d-aa90-40ce-8ec1-7ff4b72f6d02"}]} {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 16:37:27.961181 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 24 16:37:27.961181 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: warnings.warn(msg) Jun 24 16:37:27.973199 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [req-be272b9d-a6ca-48c7-8c02-84723fb6130f req-ccf78539-1890-4cda-aff8-753f45943532 service nova] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:37:27.973839 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [req-be272b9d-a6ca-48c7-8c02-84723fb6130f req-ccf78539-1890-4cda-aff8-753f45943532 service nova] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:37:27.993077 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.compute.server_external_events [req-be272b9d-a6ca-48c7-8c02-84723fb6130f req-ccf78539-1890-4cda-aff8-753f45943532 service nova] Creating event network-vif-deleted:11484e4d-aa90-40ce-8ec1-7ff4b72f6d02 for instance 4eb74274-8b99-455f-8f03-681fbea6b6e0 on hv-cinder-84718 Jun 24 16:37:27.997813 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [req-be272b9d-a6ca-48c7-8c02-84723fb6130f req-ccf78539-1890-4cda-aff8-753f45943532 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044291 Jun 24 16:37:27.998604 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 276/571] 10.222.0.18 () {64 vars in 1317 bytes} [Fri Jun 24 16:37:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 16:37:28.450014 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-ba35bc9e-d0d0-4b80-be84-e3de02204290 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Calling method '>' {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:37:28.450921 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-ba35bc9e-d0d0-4b80-be84-e3de02204290 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] [instance: 4eb74274-8b99-455f-8f03-681fbea6b6e0] Fetching instance by UUID {{(pid=102148) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:37:28.458481 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-ba35bc9e-d0d0-4b80-be84-e3de02204290 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:37:28.458958 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-ba35bc9e-d0d0-4b80-be84-e3de02204290 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:37:28.459740 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-ba35bc9e-d0d0-4b80-be84-e3de02204290 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:37:28.460173 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-ba35bc9e-d0d0-4b80-be84-e3de02204290 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:37:28.646545 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-ba35bc9e-d0d0-4b80-be84-e3de02204290 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c286a3f03048689e5ec552bb89c161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09584de3a4b14c5a90eb9b1c2149d6fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:37:28.661668 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-ba35bc9e-d0d0-4b80-be84-e3de02204290 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] 10.222.0.18 "GET /compute/v2.1/servers/4eb74274-8b99-455f-8f03-681fbea6b6e0" status: 200 len: 1306 microversion: 2.1 time: 0.214506 Jun 24 16:37:28.662739 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 296/572] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:37:28 2022] GET /compute/v2.1/servers/4eb74274-8b99-455f-8f03-681fbea6b6e0 => generated 1306 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 16:37:28.735994 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-04b45a76-1a69-4cd7-ab51-44874207ad55 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Action: 'create', calling method: .version_select at 0x7f1ae81ac160>, body: {"keypair": {"name": "tempest-keypair-1243260420", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBzNV8VnWC7oyuiLNi7RIr5FcJsvKY1uJ9tBLBmj8ixSOGpckHJfIk8aCvpeI8tAX1JLYy286e4MiyhGwQIuGf7uiIF7+V1luxdnZdo96Z7hYDNAlcA05VOEANv64Qhz/g=="}} {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 16:37:28.782738 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.quota [None req-04b45a76-1a69-4cd7-ab51-44874207ad55 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Getting quotas for project 606ba814a2d8408ab0856d539ca79b4f. Resources: {'key_pairs'} {{(pid=102149) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jun 24 16:37:28.787157 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.quota [None req-04b45a76-1a69-4cd7-ab51-44874207ad55 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Getting quotas for user 499faf87cf8c41ae823b2566e4c2d8ce and project 606ba814a2d8408ab0856d539ca79b4f. Resources: {'key_pairs'} {{(pid=102149) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jun 24 16:37:28.815719 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-04b45a76-1a69-4cd7-ab51-44874207ad55 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.087154 Jun 24 16:37:28.816729 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 277/573] 10.222.0.18 () {60 vars in 1158 bytes} [Fri Jun 24 16:37:28 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 16:37:29.689147 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-b20a4586-c259-47cf-b85b-3e5a07f94486 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Calling method '>' {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:37:29.690503 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-b20a4586-c259-47cf-b85b-3e5a07f94486 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] [instance: 4eb74274-8b99-455f-8f03-681fbea6b6e0] Fetching instance by UUID {{(pid=102148) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:37:29.703591 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-b20a4586-c259-47cf-b85b-3e5a07f94486 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:37:29.704634 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-b20a4586-c259-47cf-b85b-3e5a07f94486 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:37:29.706770 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-b20a4586-c259-47cf-b85b-3e5a07f94486 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:37:29.707072 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-b20a4586-c259-47cf-b85b-3e5a07f94486 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:37:29.913506 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-b20a4586-c259-47cf-b85b-3e5a07f94486 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c286a3f03048689e5ec552bb89c161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09584de3a4b14c5a90eb9b1c2149d6fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:37:29.928934 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-b20a4586-c259-47cf-b85b-3e5a07f94486 tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] 10.222.0.18 "GET /compute/v2.1/servers/4eb74274-8b99-455f-8f03-681fbea6b6e0" status: 200 len: 1306 microversion: 2.1 time: 0.246227 Jun 24 16:37:29.929806 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 297/574] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:37:29 2022] GET /compute/v2.1/servers/4eb74274-8b99-455f-8f03-681fbea6b6e0 => generated 1306 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 16:37:30.943001 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-8b5ebea1-1dfe-4175-adc9-cb9d20960a2f tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-464086891", "imageRef": "113c9cfb-6cee-4018-9e63-66fae82b3851", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "45be4882-d29a-4ee7-b3ed-ba8729666ff7"}], "security_groups": [{"name": "tempest-securitygroup--2143069890"}], "key_name": "tempest-keypair-1243260420", "user_data": "}} {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 16:37:30.955221 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-f2142a4b-a459-4982-b7bd-fc5e69a659ea tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Calling method '>' {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:37:30.956492 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-f2142a4b-a459-4982-b7bd-fc5e69a659ea tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] [instance: 4eb74274-8b99-455f-8f03-681fbea6b6e0] Fetching instance by UUID {{(pid=102148) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:37:30.968147 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-f2142a4b-a459-4982-b7bd-fc5e69a659ea tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:37:30.968874 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-f2142a4b-a459-4982-b7bd-fc5e69a659ea tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:37:30.970157 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-f2142a4b-a459-4982-b7bd-fc5e69a659ea tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:37:30.970912 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-f2142a4b-a459-4982-b7bd-fc5e69a659ea tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:37:31.035674 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.wsgi [None req-f2142a4b-a459-4982-b7bd-fc5e69a659ea tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] HTTP exception thrown: Instance 4eb74274-8b99-455f-8f03-681fbea6b6e0 could not be found. Jun 24 16:37:31.036672 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-f2142a4b-a459-4982-b7bd-fc5e69a659ea tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] Returning 404 to user: Instance 4eb74274-8b99-455f-8f03-681fbea6b6e0 could not be found. {{(pid=102148) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jun 24 16:37:31.037981 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-f2142a4b-a459-4982-b7bd-fc5e69a659ea tempest-ServerRescueNegativeTestJSON-1616078973 tempest-ServerRescueNegativeTestJSON-1616078973-project] 10.222.0.18 "GET /compute/v2.1/servers/4eb74274-8b99-455f-8f03-681fbea6b6e0" status: 404 len: 111 microversion: 2.1 time: 0.089748 Jun 24 16:37:31.038885 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 298/575] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:37:30 2022] GET /compute/v2.1/servers/4eb74274-8b99-455f-8f03-681fbea6b6e0 => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 24 16:37:31.121633 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.network.neutron [None req-8b5ebea1-1dfe-4175-adc9-cb9d20960a2f tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] validate_networks() for [('45be4882-d29a-4ee7-b3ed-ba8729666ff7', None, None, None)] {{(pid=102149) validate_networks /opt/stack/nova/nova/network/neutron.py:2367}} Jun 24 16:37:32.458605 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.virt.hardware [None req-8b5ebea1-1dfe-4175-adc9-cb9d20960a2f tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Flavor limits 0:0:0 {{(pid=102149) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 24 16:37:32.459423 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.virt.hardware [None req-8b5ebea1-1dfe-4175-adc9-cb9d20960a2f tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Image limits 0:0:0 {{(pid=102149) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 24 16:37:32.460317 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.virt.hardware [None req-8b5ebea1-1dfe-4175-adc9-cb9d20960a2f tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Flavor pref 0:0:0 {{(pid=102149) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 24 16:37:32.461058 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.virt.hardware [None req-8b5ebea1-1dfe-4175-adc9-cb9d20960a2f tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Image pref 0:0:0 {{(pid=102149) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 24 16:37:32.461706 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.virt.hardware [None req-8b5ebea1-1dfe-4175-adc9-cb9d20960a2f tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=102149) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 24 16:37:32.477791 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-8b5ebea1-1dfe-4175-adc9-cb9d20960a2f tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:37:32.478256 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-8b5ebea1-1dfe-4175-adc9-cb9d20960a2f tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:37:32.479091 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-8b5ebea1-1dfe-4175-adc9-cb9d20960a2f tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:37:32.479528 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-8b5ebea1-1dfe-4175-adc9-cb9d20960a2f tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:37:32.498156 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.quota [None req-8b5ebea1-1dfe-4175-adc9-cb9d20960a2f tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Getting quotas for project 606ba814a2d8408ab0856d539ca79b4f. Resources: {'ram', 'instances', 'cores'} {{(pid=102149) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jun 24 16:37:32.502537 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.quota [None req-8b5ebea1-1dfe-4175-adc9-cb9d20960a2f tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Getting quotas for user 499faf87cf8c41ae823b2566e4c2d8ce and project 606ba814a2d8408ab0856d539ca79b4f. Resources: {'ram', 'instances', 'cores'} {{(pid=102149) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jun 24 16:37:32.514294 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-8b5ebea1-1dfe-4175-adc9-cb9d20960a2f tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Going to run 1 instances... {{(pid=102149) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Jun 24 16:37:32.516750 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-8b5ebea1-1dfe-4175-adc9-cb9d20960a2f tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] [instance: 1c66f8ad-8bbd-4134-9f8c-7fdb0be9dc48] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='113c9cfb-6cee-4018-9e63-66fae82b3851',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=102149) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1684}} Jun 24 16:37:32.573970 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-8b5ebea1-1dfe-4175-adc9-cb9d20960a2f tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.635302 Jun 24 16:37:32.575193 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 278/576] 10.222.0.18 () {60 vars in 1146 bytes} [Fri Jun 24 16:37:30 2022] POST /compute/v2.1/servers => generated 402 bytes in 1638 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 24 16:37:32.588176 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-15e261e3-e525-4cd1-9968-0d8e95d2e9a7 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Calling method '>' {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:37:32.588962 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-15e261e3-e525-4cd1-9968-0d8e95d2e9a7 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] [instance: 1c66f8ad-8bbd-4134-9f8c-7fdb0be9dc48] Fetching instance by UUID {{(pid=102148) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:37:32.769488 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-15e261e3-e525-4cd1-9968-0d8e95d2e9a7 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '499faf87cf8c41ae823b2566e4c2d8ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606ba814a2d8408ab0856d539ca79b4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:37:32.780385 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-15e261e3-e525-4cd1-9968-0d8e95d2e9a7 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] 10.222.0.18 "GET /compute/v2.1/servers/1c66f8ad-8bbd-4134-9f8c-7fdb0be9dc48" status: 200 len: 1241 microversion: 2.1 time: 0.195579 Jun 24 16:37:32.781276 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 299/577] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:37:32 2022] GET /compute/v2.1/servers/1c66f8ad-8bbd-4134-9f8c-7fdb0be9dc48 => generated 1241 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 16:37:33.809379 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-0f84ac2b-0397-4e2a-8e99-3965b9423796 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Calling method '>' {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:37:33.810966 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-0f84ac2b-0397-4e2a-8e99-3965b9423796 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] [instance: 1c66f8ad-8bbd-4134-9f8c-7fdb0be9dc48] Fetching instance by UUID {{(pid=102149) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:37:33.844137 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-0f84ac2b-0397-4e2a-8e99-3965b9423796 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:37:33.845299 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-0f84ac2b-0397-4e2a-8e99-3965b9423796 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:37:33.847107 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-0f84ac2b-0397-4e2a-8e99-3965b9423796 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:37:33.860550 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-0f84ac2b-0397-4e2a-8e99-3965b9423796 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:37:34.156937 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-0f84ac2b-0397-4e2a-8e99-3965b9423796 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '499faf87cf8c41ae823b2566e4c2d8ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606ba814a2d8408ab0856d539ca79b4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:37:34.175000 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-0f84ac2b-0397-4e2a-8e99-3965b9423796 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] 10.222.0.18 "GET /compute/v2.1/servers/1c66f8ad-8bbd-4134-9f8c-7fdb0be9dc48" status: 200 len: 1301 microversion: 2.1 time: 0.372804 Jun 24 16:37:34.175699 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 279/578] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:37:33 2022] GET /compute/v2.1/servers/1c66f8ad-8bbd-4134-9f8c-7fdb0be9dc48 => generated 1301 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 16:37:35.203233 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-63637100-c772-4b70-b7b3-64c6731b71c0 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Calling method '>' {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:37:35.206257 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-63637100-c772-4b70-b7b3-64c6731b71c0 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] [instance: 1c66f8ad-8bbd-4134-9f8c-7fdb0be9dc48] Fetching instance by UUID {{(pid=102148) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:37:35.239053 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-63637100-c772-4b70-b7b3-64c6731b71c0 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:37:35.240645 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-63637100-c772-4b70-b7b3-64c6731b71c0 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:37:35.248291 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-63637100-c772-4b70-b7b3-64c6731b71c0 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:37:35.250142 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-63637100-c772-4b70-b7b3-64c6731b71c0 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:37:35.735685 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-63637100-c772-4b70-b7b3-64c6731b71c0 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '499faf87cf8c41ae823b2566e4c2d8ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606ba814a2d8408ab0856d539ca79b4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:37:35.749722 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-63637100-c772-4b70-b7b3-64c6731b71c0 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] 10.222.0.18 "GET /compute/v2.1/servers/1c66f8ad-8bbd-4134-9f8c-7fdb0be9dc48" status: 200 len: 1367 microversion: 2.1 time: 0.552708 Jun 24 16:37:35.751029 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 300/579] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:37:35 2022] GET /compute/v2.1/servers/1c66f8ad-8bbd-4134-9f8c-7fdb0be9dc48 => generated 1367 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 16:37:36.774270 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-0d93f8c7-64ff-4ac6-b725-35c441e76f5f tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Calling method '>' {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:37:36.775583 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-0d93f8c7-64ff-4ac6-b725-35c441e76f5f tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] [instance: 1c66f8ad-8bbd-4134-9f8c-7fdb0be9dc48] Fetching instance by UUID {{(pid=102149) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:37:36.786079 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-0d93f8c7-64ff-4ac6-b725-35c441e76f5f tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:37:36.787390 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-0d93f8c7-64ff-4ac6-b725-35c441e76f5f tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:37:36.789038 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-0d93f8c7-64ff-4ac6-b725-35c441e76f5f tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:37:36.790322 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-0d93f8c7-64ff-4ac6-b725-35c441e76f5f tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:37:37.216503 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-0d93f8c7-64ff-4ac6-b725-35c441e76f5f tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '499faf87cf8c41ae823b2566e4c2d8ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606ba814a2d8408ab0856d539ca79b4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:37:37.255084 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-0d93f8c7-64ff-4ac6-b725-35c441e76f5f tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] 10.222.0.18 "GET /compute/v2.1/servers/1c66f8ad-8bbd-4134-9f8c-7fdb0be9dc48" status: 200 len: 1367 microversion: 2.1 time: 0.484462 Jun 24 16:37:37.260459 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 280/580] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:37:36 2022] GET /compute/v2.1/servers/1c66f8ad-8bbd-4134-9f8c-7fdb0be9dc48 => generated 1367 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 16:37:37.772253 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [req-79615a86-30cb-4cd3-94fb-4f05e8ca76a6 req-d4d0311c-b16f-40e3-990e-9ca8fae4b156 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1c66f8ad-8bbd-4134-9f8c-7fdb0be9dc48", "tag": "12a399ee-3431-4fdd-9fd8-fd3020deecf2"}]} {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 16:37:37.775664 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 24 16:37:37.775664 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: warnings.warn(msg) Jun 24 16:37:37.792024 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [req-79615a86-30cb-4cd3-94fb-4f05e8ca76a6 req-d4d0311c-b16f-40e3-990e-9ca8fae4b156 service nova] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:37:37.792733 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [req-79615a86-30cb-4cd3-94fb-4f05e8ca76a6 req-d4d0311c-b16f-40e3-990e-9ca8fae4b156 service nova] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:37:37.823145 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.compute.server_external_events [req-79615a86-30cb-4cd3-94fb-4f05e8ca76a6 req-d4d0311c-b16f-40e3-990e-9ca8fae4b156 service nova] Creating event network-changed:12a399ee-3431-4fdd-9fd8-fd3020deecf2 for instance 1c66f8ad-8bbd-4134-9f8c-7fdb0be9dc48 on hv-cinder-84718 Jun 24 16:37:37.831518 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [req-79615a86-30cb-4cd3-94fb-4f05e8ca76a6 req-d4d0311c-b16f-40e3-990e-9ca8fae4b156 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066040 Jun 24 16:37:37.833637 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 301/581] 10.222.0.18 () {64 vars in 1317 bytes} [Fri Jun 24 16:37:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 16:37:38.290487 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-03b2b71f-d58e-4914-a43f-d2695c4675fe tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Calling method '>' {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:37:38.291289 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-03b2b71f-d58e-4914-a43f-d2695c4675fe tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] [instance: 1c66f8ad-8bbd-4134-9f8c-7fdb0be9dc48] Fetching instance by UUID {{(pid=102149) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:37:38.299137 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-03b2b71f-d58e-4914-a43f-d2695c4675fe tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:37:38.299732 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-03b2b71f-d58e-4914-a43f-d2695c4675fe tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:37:38.300527 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-03b2b71f-d58e-4914-a43f-d2695c4675fe tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:37:38.301540 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-03b2b71f-d58e-4914-a43f-d2695c4675fe tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:37:38.559323 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-03b2b71f-d58e-4914-a43f-d2695c4675fe tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '499faf87cf8c41ae823b2566e4c2d8ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606ba814a2d8408ab0856d539ca79b4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:37:38.575732 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-03b2b71f-d58e-4914-a43f-d2695c4675fe tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] 10.222.0.18 "GET /compute/v2.1/servers/1c66f8ad-8bbd-4134-9f8c-7fdb0be9dc48" status: 200 len: 1367 microversion: 2.1 time: 0.292979 Jun 24 16:37:38.576745 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 281/582] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:37:38 2022] GET /compute/v2.1/servers/1c66f8ad-8bbd-4134-9f8c-7fdb0be9dc48 => generated 1367 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 16:37:39.607757 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-2cd04973-76e8-40ee-9ad2-be1b4014c63e tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Calling method '>' {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:37:39.609596 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-2cd04973-76e8-40ee-9ad2-be1b4014c63e tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] [instance: 1c66f8ad-8bbd-4134-9f8c-7fdb0be9dc48] Fetching instance by UUID {{(pid=102148) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:37:39.621405 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-2cd04973-76e8-40ee-9ad2-be1b4014c63e tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:37:39.622122 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-2cd04973-76e8-40ee-9ad2-be1b4014c63e tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:37:39.623229 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-2cd04973-76e8-40ee-9ad2-be1b4014c63e tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:37:39.623785 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-2cd04973-76e8-40ee-9ad2-be1b4014c63e tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:37:39.982860 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-2cd04973-76e8-40ee-9ad2-be1b4014c63e tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '499faf87cf8c41ae823b2566e4c2d8ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606ba814a2d8408ab0856d539ca79b4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:37:39.997405 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-2cd04973-76e8-40ee-9ad2-be1b4014c63e tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] 10.222.0.18 "GET /compute/v2.1/servers/1c66f8ad-8bbd-4134-9f8c-7fdb0be9dc48" status: 200 len: 1367 microversion: 2.1 time: 0.398223 Jun 24 16:37:39.998426 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 302/583] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:37:39 2022] GET /compute/v2.1/servers/1c66f8ad-8bbd-4134-9f8c-7fdb0be9dc48 => generated 1367 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 16:37:41.020324 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-46f4bd50-3108-4382-85cd-5e52587d4581 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Calling method '>' {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:37:41.022353 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-46f4bd50-3108-4382-85cd-5e52587d4581 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] [instance: 1c66f8ad-8bbd-4134-9f8c-7fdb0be9dc48] Fetching instance by UUID {{(pid=102149) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:37:41.034139 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-46f4bd50-3108-4382-85cd-5e52587d4581 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:37:41.035181 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-46f4bd50-3108-4382-85cd-5e52587d4581 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:37:41.036890 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-46f4bd50-3108-4382-85cd-5e52587d4581 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:37:41.037534 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-46f4bd50-3108-4382-85cd-5e52587d4581 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:37:41.308768 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-46f4bd50-3108-4382-85cd-5e52587d4581 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '499faf87cf8c41ae823b2566e4c2d8ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606ba814a2d8408ab0856d539ca79b4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:37:41.326736 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-46f4bd50-3108-4382-85cd-5e52587d4581 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] 10.222.0.18 "GET /compute/v2.1/servers/1c66f8ad-8bbd-4134-9f8c-7fdb0be9dc48" status: 200 len: 1367 microversion: 2.1 time: 0.314243 Jun 24 16:37:41.342784 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 282/584] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:37:41 2022] GET /compute/v2.1/servers/1c66f8ad-8bbd-4134-9f8c-7fdb0be9dc48 => generated 1367 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 16:37:42.353737 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-3d65ea1a-3ccc-4ead-962c-a495aadc1e93 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Calling method '>' {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:37:42.354595 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-3d65ea1a-3ccc-4ead-962c-a495aadc1e93 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] [instance: 1c66f8ad-8bbd-4134-9f8c-7fdb0be9dc48] Fetching instance by UUID {{(pid=102148) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:37:42.362005 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-3d65ea1a-3ccc-4ead-962c-a495aadc1e93 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:37:42.362454 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-3d65ea1a-3ccc-4ead-962c-a495aadc1e93 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:37:42.363968 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-3d65ea1a-3ccc-4ead-962c-a495aadc1e93 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:37:42.364642 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-3d65ea1a-3ccc-4ead-962c-a495aadc1e93 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:37:42.583310 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-3d65ea1a-3ccc-4ead-962c-a495aadc1e93 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '499faf87cf8c41ae823b2566e4c2d8ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606ba814a2d8408ab0856d539ca79b4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:37:42.592218 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-3d65ea1a-3ccc-4ead-962c-a495aadc1e93 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] 10.222.0.18 "GET /compute/v2.1/servers/1c66f8ad-8bbd-4134-9f8c-7fdb0be9dc48" status: 200 len: 1367 microversion: 2.1 time: 0.242265 Jun 24 16:37:42.592792 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 303/585] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:37:42 2022] GET /compute/v2.1/servers/1c66f8ad-8bbd-4134-9f8c-7fdb0be9dc48 => generated 1367 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 16:37:43.105208 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-f5a5a6c1-7377-4e1a-a0ed-5a0e391cb0db tempest-VolumesTestJSON-636184630 tempest-VolumesTestJSON-636184630-project] Calling method '.version_select at 0x7f1ae8500820>' {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:37:43.203576 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-f5a5a6c1-7377-4e1a-a0ed-5a0e391cb0db tempest-VolumesTestJSON-636184630 tempest-VolumesTestJSON-636184630-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/afff5de2-bc29-4991-9f00-994efd129bf5" status: 200 len: 351 microversion: 2.1 time: 0.103711 Jun 24 16:37:43.204397 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 283/586] 10.222.0.18 () {58 vars in 1244 bytes} [Fri Jun 24 16:37:43 2022] GET /compute/v2.1/os-volumes/afff5de2-bc29-4991-9f00-994efd129bf5 => generated 351 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 16:37:43.613099 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-cb35b686-e3a3-48db-ba30-d2aaae08ddbf tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Calling method '>' {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:37:43.614067 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-cb35b686-e3a3-48db-ba30-d2aaae08ddbf tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] [instance: 1c66f8ad-8bbd-4134-9f8c-7fdb0be9dc48] Fetching instance by UUID {{(pid=102148) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:37:43.642707 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-cb35b686-e3a3-48db-ba30-d2aaae08ddbf tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:37:43.643705 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-cb35b686-e3a3-48db-ba30-d2aaae08ddbf tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:37:43.646427 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-cb35b686-e3a3-48db-ba30-d2aaae08ddbf tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:37:43.647072 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-cb35b686-e3a3-48db-ba30-d2aaae08ddbf tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:37:43.965859 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-cb35b686-e3a3-48db-ba30-d2aaae08ddbf tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '499faf87cf8c41ae823b2566e4c2d8ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606ba814a2d8408ab0856d539ca79b4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:37:43.976537 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-cb35b686-e3a3-48db-ba30-d2aaae08ddbf tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] 10.222.0.18 "GET /compute/v2.1/servers/1c66f8ad-8bbd-4134-9f8c-7fdb0be9dc48" status: 200 len: 1367 microversion: 2.1 time: 0.369798 Jun 24 16:37:43.977007 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 304/587] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:37:43 2022] GET /compute/v2.1/servers/1c66f8ad-8bbd-4134-9f8c-7fdb0be9dc48 => generated 1367 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 16:37:44.867519 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-6cbb68f7-fbe7-4f63-9224-ea998a3cf21c tempest-VolumesTestJSON-636184630 tempest-VolumesTestJSON-636184630-project] Calling method '.version_select at 0x7f1ae81acee0>' {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:37:44.959121 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-6cbb68f7-fbe7-4f63-9224-ea998a3cf21c tempest-VolumesTestJSON-636184630 tempest-VolumesTestJSON-636184630-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/f9bc6674-7c65-4d23-a26a-009d2afd27db" status: 200 len: 351 microversion: 2.1 time: 0.094610 Jun 24 16:37:44.959121 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 284/588] 10.222.0.18 () {58 vars in 1244 bytes} [Fri Jun 24 16:37:44 2022] GET /compute/v2.1/os-volumes/f9bc6674-7c65-4d23-a26a-009d2afd27db => generated 351 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 16:37:45.002482 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-9ccca49b-cf01-43f5-9c0a-c60451405715 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Calling method '>' {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:37:45.003549 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-9ccca49b-cf01-43f5-9c0a-c60451405715 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] [instance: 1c66f8ad-8bbd-4134-9f8c-7fdb0be9dc48] Fetching instance by UUID {{(pid=102148) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:37:45.015029 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-9ccca49b-cf01-43f5-9c0a-c60451405715 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:37:45.015480 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-9ccca49b-cf01-43f5-9c0a-c60451405715 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:37:45.016253 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-9ccca49b-cf01-43f5-9c0a-c60451405715 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:37:45.016679 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-9ccca49b-cf01-43f5-9c0a-c60451405715 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:37:45.277339 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-9ccca49b-cf01-43f5-9c0a-c60451405715 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '499faf87cf8c41ae823b2566e4c2d8ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606ba814a2d8408ab0856d539ca79b4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:37:45.287169 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-9ccca49b-cf01-43f5-9c0a-c60451405715 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] 10.222.0.18 "GET /compute/v2.1/servers/1c66f8ad-8bbd-4134-9f8c-7fdb0be9dc48" status: 200 len: 1367 microversion: 2.1 time: 0.290976 Jun 24 16:37:45.288055 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 305/589] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:37:44 2022] GET /compute/v2.1/servers/1c66f8ad-8bbd-4134-9f8c-7fdb0be9dc48 => generated 1367 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 16:37:45.813381 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [req-4ebf3439-79a0-48b6-a168-70cfb5aca20c req-e3a07a82-12ad-4c6c-8199-6b35b19b52d9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1c66f8ad-8bbd-4134-9f8c-7fdb0be9dc48", "name": "network-vif-plugged", "status": "completed", "tag": "12a399ee-3431-4fdd-9fd8-fd3020deecf2"}]} {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 16:37:45.815259 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 24 16:37:45.815259 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: warnings.warn(msg) Jun 24 16:37:45.824883 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [req-4ebf3439-79a0-48b6-a168-70cfb5aca20c req-e3a07a82-12ad-4c6c-8199-6b35b19b52d9 service nova] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:37:45.825317 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [req-4ebf3439-79a0-48b6-a168-70cfb5aca20c req-e3a07a82-12ad-4c6c-8199-6b35b19b52d9 service nova] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:37:45.841821 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.compute.server_external_events [req-4ebf3439-79a0-48b6-a168-70cfb5aca20c req-e3a07a82-12ad-4c6c-8199-6b35b19b52d9 service nova] Creating event network-vif-plugged:12a399ee-3431-4fdd-9fd8-fd3020deecf2 for instance 1c66f8ad-8bbd-4134-9f8c-7fdb0be9dc48 on hv-cinder-84718 Jun 24 16:37:45.847533 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [req-4ebf3439-79a0-48b6-a168-70cfb5aca20c req-e3a07a82-12ad-4c6c-8199-6b35b19b52d9 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.199022 Jun 24 16:37:45.848138 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 285/590] 10.222.0.18 () {64 vars in 1317 bytes} [Fri Jun 24 16:37:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 16:37:46.309881 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-111390fe-70fb-470e-9715-00b7c35a7716 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Calling method '>' {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:37:46.310599 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-111390fe-70fb-470e-9715-00b7c35a7716 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] [instance: 1c66f8ad-8bbd-4134-9f8c-7fdb0be9dc48] Fetching instance by UUID {{(pid=102148) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:37:46.320987 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-111390fe-70fb-470e-9715-00b7c35a7716 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:37:46.321441 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-111390fe-70fb-470e-9715-00b7c35a7716 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:37:46.322242 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-111390fe-70fb-470e-9715-00b7c35a7716 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:37:46.322680 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-111390fe-70fb-470e-9715-00b7c35a7716 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:37:46.561216 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-a58b722e-9bb6-4d95-a40a-506da9a8a665 tempest-VolumesTestJSON-636184630 tempest-VolumesTestJSON-636184630-project] Calling method '.version_select at 0x7f1ae85004c0>' {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:37:46.562176 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-111390fe-70fb-470e-9715-00b7c35a7716 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '499faf87cf8c41ae823b2566e4c2d8ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606ba814a2d8408ab0856d539ca79b4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:37:46.572482 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-111390fe-70fb-470e-9715-00b7c35a7716 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] 10.222.0.18 "GET /compute/v2.1/servers/1c66f8ad-8bbd-4134-9f8c-7fdb0be9dc48" status: 200 len: 1367 microversion: 2.1 time: 0.266163 Jun 24 16:37:46.573063 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 306/591] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:37:46 2022] GET /compute/v2.1/servers/1c66f8ad-8bbd-4134-9f8c-7fdb0be9dc48 => generated 1367 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 16:37:46.654391 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-a58b722e-9bb6-4d95-a40a-506da9a8a665 tempest-VolumesTestJSON-636184630 tempest-VolumesTestJSON-636184630-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/dd3cfa5d-f282-43de-a0ca-194d351b404c" status: 200 len: 350 microversion: 2.1 time: 0.097708 Jun 24 16:37:46.655025 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 286/592] 10.222.0.18 () {58 vars in 1244 bytes} [Fri Jun 24 16:37:46 2022] GET /compute/v2.1/os-volumes/dd3cfa5d-f282-43de-a0ca-194d351b404c => generated 350 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 16:37:46.666953 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-00664f6e-95a9-4097-9867-5dc6246aadfc tempest-VolumesTestJSON-636184630 tempest-VolumesTestJSON-636184630-project] Calling method '.version_select at 0x7f1ae851d0d0>' {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:37:46.757449 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-00664f6e-95a9-4097-9867-5dc6246aadfc tempest-VolumesTestJSON-636184630 tempest-VolumesTestJSON-636184630-project] 10.222.0.18 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.093946 Jun 24 16:37:46.758057 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 307/593] 10.222.0.18 () {58 vars in 1133 bytes} [Fri Jun 24 16:37:46 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 16:37:46.770729 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-e43a31f4-9260-4c2c-a077-eb6eac49d869 tempest-VolumesTestJSON-636184630 tempest-VolumesTestJSON-636184630-project] Calling method '.version_select at 0x7f1ae8504160>' {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:37:46.854720 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-e43a31f4-9260-4c2c-a077-eb6eac49d869 tempest-VolumesTestJSON-636184630 tempest-VolumesTestJSON-636184630-project] 10.222.0.18 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.088050 Jun 24 16:37:46.855312 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 287/594] 10.222.0.18 () {58 vars in 1148 bytes} [Fri Jun 24 16:37:46 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 16:37:46.867206 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-87eb491b-58d0-4659-bf35-c9d28adadc92 tempest-VolumesTestJSON-636184630 tempest-VolumesTestJSON-636184630-project] Calling method '.version_select at 0x7f1ae83553a0>' {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:37:46.958753 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-87eb491b-58d0-4659-bf35-c9d28adadc92 tempest-VolumesTestJSON-636184630 tempest-VolumesTestJSON-636184630-project] 10.222.0.18 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.095296 Jun 24 16:37:46.959381 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 308/595] 10.222.0.18 () {58 vars in 1133 bytes} [Fri Jun 24 16:37:46 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 16:37:46.970582 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-e7d8630e-7f2f-46f0-92b4-724e53014fde tempest-VolumesTestJSON-636184630 tempest-VolumesTestJSON-636184630-project] Calling method '.version_select at 0x7f1ae81ac040>' {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:37:47.058887 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-e7d8630e-7f2f-46f0-92b4-724e53014fde tempest-VolumesTestJSON-636184630 tempest-VolumesTestJSON-636184630-project] 10.222.0.18 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.091762 Jun 24 16:37:47.059532 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 288/596] 10.222.0.18 () {58 vars in 1166 bytes} [Fri Jun 24 16:37:46 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 16:37:47.072670 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-e8f77b2c-25ae-407d-9ae5-f40ef609cd6b tempest-VolumesTestJSON-636184630 tempest-VolumesTestJSON-636184630-project] Calling method '.version_select at 0x7f1ae82b0310>' {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:37:47.158720 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-e8f77b2c-25ae-407d-9ae5-f40ef609cd6b tempest-VolumesTestJSON-636184630 tempest-VolumesTestJSON-636184630-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.089195 Jun 24 16:37:47.159777 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 309/597] 10.222.0.18 () {58 vars in 1169 bytes} [Fri Jun 24 16:37:47 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 16:37:47.172074 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-ef54b993-473e-4162-b7b3-a9829c535a61 tempest-VolumesTestJSON-636184630 tempest-VolumesTestJSON-636184630-project] Calling method '.version_select at 0x7f1ae81acd30>' {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:37:47.259931 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-ef54b993-473e-4162-b7b3-a9829c535a61 tempest-VolumesTestJSON-636184630 tempest-VolumesTestJSON-636184630-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.091577 Jun 24 16:37:47.260511 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 289/598] 10.222.0.18 () {58 vars in 1154 bytes} [Fri Jun 24 16:37:47 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 16:37:47.274950 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-e9c7555c-72f3-4d35-adcd-e751742a3fb1 tempest-VolumesTestJSON-636184630 tempest-VolumesTestJSON-636184630-project] Calling method '.version_select at 0x7f1ae8355280>' {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:37:47.361997 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-e9c7555c-72f3-4d35-adcd-e751742a3fb1 tempest-VolumesTestJSON-636184630 tempest-VolumesTestJSON-636184630-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.093290 Jun 24 16:37:47.362947 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 310/599] 10.222.0.18 () {58 vars in 1187 bytes} [Fri Jun 24 16:37:47 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 16:37:47.374681 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-2178df00-cf43-4ffe-ad4f-f3b55a116bce tempest-VolumesTestJSON-636184630 tempest-VolumesTestJSON-636184630-project] Calling method '.version_select at 0x7f1ae8429dc0>' {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:37:47.501509 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-2178df00-cf43-4ffe-ad4f-f3b55a116bce tempest-VolumesTestJSON-636184630 tempest-VolumesTestJSON-636184630-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.130518 Jun 24 16:37:47.502693 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 290/600] 10.222.0.18 () {58 vars in 1154 bytes} [Fri Jun 24 16:37:47 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 16:37:47.592404 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-6dba3f56-dad4-45ed-ab57-bb8519dc1ee5 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Calling method '>' {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:37:47.593573 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-6dba3f56-dad4-45ed-ab57-bb8519dc1ee5 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] [instance: 1c66f8ad-8bbd-4134-9f8c-7fdb0be9dc48] Fetching instance by UUID {{(pid=102148) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:37:47.612632 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-6dba3f56-dad4-45ed-ab57-bb8519dc1ee5 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:37:47.616831 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-6dba3f56-dad4-45ed-ab57-bb8519dc1ee5 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:37:47.618263 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-6dba3f56-dad4-45ed-ab57-bb8519dc1ee5 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:37:47.619146 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-6dba3f56-dad4-45ed-ab57-bb8519dc1ee5 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:37:47.894663 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-6dba3f56-dad4-45ed-ab57-bb8519dc1ee5 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '499faf87cf8c41ae823b2566e4c2d8ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606ba814a2d8408ab0856d539ca79b4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:37:47.903915 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-6dba3f56-dad4-45ed-ab57-bb8519dc1ee5 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] 10.222.0.18 "GET /compute/v2.1/servers/1c66f8ad-8bbd-4134-9f8c-7fdb0be9dc48" status: 200 len: 1558 microversion: 2.1 time: 0.317238 Jun 24 16:37:47.904492 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 311/601] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:37:47 2022] GET /compute/v2.1/servers/1c66f8ad-8bbd-4134-9f8c-7fdb0be9dc48 => generated 1558 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 16:37:47.921029 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-c1a97e47-9b49-424d-a17d-88bd9881fbde tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Calling method '>' {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:37:47.921645 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-c1a97e47-9b49-424d-a17d-88bd9881fbde tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] [instance: 1c66f8ad-8bbd-4134-9f8c-7fdb0be9dc48] Fetching instance by UUID {{(pid=102149) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:37:47.933949 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-c1a97e47-9b49-424d-a17d-88bd9881fbde tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:37:47.934618 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-c1a97e47-9b49-424d-a17d-88bd9881fbde tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:37:47.935746 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-c1a97e47-9b49-424d-a17d-88bd9881fbde tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:37:47.936219 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-c1a97e47-9b49-424d-a17d-88bd9881fbde tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:37:48.110011 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-c1a97e47-9b49-424d-a17d-88bd9881fbde tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] 10.222.0.18 "GET /compute/v2.1/servers/1c66f8ad-8bbd-4134-9f8c-7fdb0be9dc48/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.192290 Jun 24 16:37:48.110910 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 291/602] 10.222.0.18 () {58 vars in 1274 bytes} [Fri Jun 24 16:37:47 2022] GET /compute/v2.1/servers/1c66f8ad-8bbd-4134-9f8c-7fdb0be9dc48/os-interface => generated 285 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 16:37:50.213475 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [req-b0b51664-7708-4d8b-abee-6f68c4337a54 req-5ec2c451-b121-48e9-8ad3-c6356a62a2a2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1c66f8ad-8bbd-4134-9f8c-7fdb0be9dc48", "tag": "12a399ee-3431-4fdd-9fd8-fd3020deecf2"}]} {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 16:37:50.218535 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 24 16:37:50.218535 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: warnings.warn(msg) Jun 24 16:37:50.236334 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [req-b0b51664-7708-4d8b-abee-6f68c4337a54 req-5ec2c451-b121-48e9-8ad3-c6356a62a2a2 service nova] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:37:50.237193 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [req-b0b51664-7708-4d8b-abee-6f68c4337a54 req-5ec2c451-b121-48e9-8ad3-c6356a62a2a2 service nova] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:37:50.280632 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.compute.server_external_events [req-b0b51664-7708-4d8b-abee-6f68c4337a54 req-5ec2c451-b121-48e9-8ad3-c6356a62a2a2 service nova] Creating event network-changed:12a399ee-3431-4fdd-9fd8-fd3020deecf2 for instance 1c66f8ad-8bbd-4134-9f8c-7fdb0be9dc48 on hv-cinder-84718 Jun 24 16:37:50.294463 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [req-b0b51664-7708-4d8b-abee-6f68c4337a54 req-5ec2c451-b121-48e9-8ad3-c6356a62a2a2 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092083 Jun 24 16:37:50.298449 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 312/603] 10.222.0.18 () {64 vars in 1317 bytes} [Fri Jun 24 16:37:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 16:37:57.013348 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-0a24e89a-21da-473a-aed3-44b28714d2dc tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Calling method '>' {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:37:57.014017 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-0a24e89a-21da-473a-aed3-44b28714d2dc tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] [instance: 72af7667-a283-4567-894f-2bd233c01001] Fetching instance by UUID {{(pid=102149) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:37:57.025595 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-0a24e89a-21da-473a-aed3-44b28714d2dc tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:37:57.026067 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-0a24e89a-21da-473a-aed3-44b28714d2dc tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:37:57.026911 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-0a24e89a-21da-473a-aed3-44b28714d2dc tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:37:57.027352 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-0a24e89a-21da-473a-aed3-44b28714d2dc tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:37:57.093831 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-0a24e89a-21da-473a-aed3-44b28714d2dc tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] 10.222.0.18 "GET /compute/v2.1/servers/72af7667-a283-4567-894f-2bd233c01001/ips" status: 200 len: 151 microversion: 2.20 time: 0.084854 Jun 24 16:37:57.095736 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 292/604] 10.222.0.18 () {60 vars in 1288 bytes} [Fri Jun 24 16:37:57 2022] GET /compute/v2.1/servers/72af7667-a283-4567-894f-2bd233c01001/ips => generated 151 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 16:37:59.181545 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-02e5a6e6-236c-4df4-a263-d80a0eb2b737 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 16:37:59.183124 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-02e5a6e6-236c-4df4-a263-d80a0eb2b737 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] [instance: 72af7667-a283-4567-894f-2bd233c01001] Fetching instance by UUID {{(pid=102148) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:37:59.191818 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-02e5a6e6-236c-4df4-a263-d80a0eb2b737 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:37:59.192261 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-02e5a6e6-236c-4df4-a263-d80a0eb2b737 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:37:59.193106 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-02e5a6e6-236c-4df4-a263-d80a0eb2b737 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:37:59.193573 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-02e5a6e6-236c-4df4-a263-d80a0eb2b737 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:37:59.268454 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.objects.instance [None req-02e5a6e6-236c-4df4-a263-d80a0eb2b737 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lazy-loading 'flavor' on Instance uuid 72af7667-a283-4567-894f-2bd233c01001 {{(pid=102148) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Jun 24 16:37:59.745242 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-02e5a6e6-236c-4df4-a263-d80a0eb2b737 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] 10.222.0.18 "POST /compute/v2.1/servers/72af7667-a283-4567-894f-2bd233c01001/action" status: 202 len: 0 microversion: 2.20 time: 0.568114 Jun 24 16:37:59.745935 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 313/605] 10.222.0.18 () {62 vars in 1318 bytes} [Fri Jun 24 16:37:59 2022] POST /compute/v2.1/servers/72af7667-a283-4567-894f-2bd233c01001/action => generated 0 bytes in 572 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 24 16:37:59.755063 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-39c07d22-8fc5-4ea3-8412-6001ec8b3a1e tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Calling method '>' {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:37:59.756104 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-39c07d22-8fc5-4ea3-8412-6001ec8b3a1e tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] [instance: 72af7667-a283-4567-894f-2bd233c01001] Fetching instance by UUID {{(pid=102149) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:37:59.763734 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-39c07d22-8fc5-4ea3-8412-6001ec8b3a1e tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:37:59.764420 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-39c07d22-8fc5-4ea3-8412-6001ec8b3a1e tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:37:59.765569 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-39c07d22-8fc5-4ea3-8412-6001ec8b3a1e tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:37:59.766129 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-39c07d22-8fc5-4ea3-8412-6001ec8b3a1e tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:38:00.021839 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-39c07d22-8fc5-4ea3-8412-6001ec8b3a1e tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7489b29cb3ef47d78dfd55794f338b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065254ebe67545639644fcbc6bd9fc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:38:00.031942 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-39c07d22-8fc5-4ea3-8412-6001ec8b3a1e tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7489b29cb3ef47d78dfd55794f338b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065254ebe67545639644fcbc6bd9fc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:38:00.033447 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-39c07d22-8fc5-4ea3-8412-6001ec8b3a1e tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7489b29cb3ef47d78dfd55794f338b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065254ebe67545639644fcbc6bd9fc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:38:00.034596 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-39c07d22-8fc5-4ea3-8412-6001ec8b3a1e tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] 10.222.0.18 "GET /compute/v2.1/servers/72af7667-a283-4567-894f-2bd233c01001" status: 200 len: 1723 microversion: 2.20 time: 0.283921 Jun 24 16:38:00.035197 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 293/606] 10.222.0.18 () {60 vars in 1276 bytes} [Fri Jun 24 16:37:59 2022] GET /compute/v2.1/servers/72af7667-a283-4567-894f-2bd233c01001 => generated 1723 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 16:38:01.056361 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-aad161b4-768c-4911-9a6b-98b81d9b7f5b tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Calling method '>' {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:38:01.057541 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-aad161b4-768c-4911-9a6b-98b81d9b7f5b tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] [instance: 72af7667-a283-4567-894f-2bd233c01001] Fetching instance by UUID {{(pid=102148) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:38:01.070228 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-aad161b4-768c-4911-9a6b-98b81d9b7f5b tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:38:01.071106 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-aad161b4-768c-4911-9a6b-98b81d9b7f5b tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:38:01.072438 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-aad161b4-768c-4911-9a6b-98b81d9b7f5b tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:38:01.073252 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-aad161b4-768c-4911-9a6b-98b81d9b7f5b tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:38:01.311078 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-aad161b4-768c-4911-9a6b-98b81d9b7f5b tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7489b29cb3ef47d78dfd55794f338b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065254ebe67545639644fcbc6bd9fc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:38:01.326456 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-aad161b4-768c-4911-9a6b-98b81d9b7f5b tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7489b29cb3ef47d78dfd55794f338b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065254ebe67545639644fcbc6bd9fc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:38:01.329409 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-aad161b4-768c-4911-9a6b-98b81d9b7f5b tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7489b29cb3ef47d78dfd55794f338b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065254ebe67545639644fcbc6bd9fc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:38:01.330931 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-aad161b4-768c-4911-9a6b-98b81d9b7f5b tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] 10.222.0.18 "GET /compute/v2.1/servers/72af7667-a283-4567-894f-2bd233c01001" status: 200 len: 1723 microversion: 2.20 time: 0.281287 Jun 24 16:38:01.332067 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 314/607] 10.222.0.18 () {60 vars in 1276 bytes} [Fri Jun 24 16:38:01 2022] GET /compute/v2.1/servers/72af7667-a283-4567-894f-2bd233c01001 => generated 1723 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 16:38:02.356737 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-f7430fbe-890c-4a67-a532-62ef0a2e5df1 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Calling method '>' {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:38:02.359188 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-f7430fbe-890c-4a67-a532-62ef0a2e5df1 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] [instance: 72af7667-a283-4567-894f-2bd233c01001] Fetching instance by UUID {{(pid=102149) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:38:02.366451 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-f7430fbe-890c-4a67-a532-62ef0a2e5df1 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:38:02.366918 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-f7430fbe-890c-4a67-a532-62ef0a2e5df1 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:38:02.367690 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-f7430fbe-890c-4a67-a532-62ef0a2e5df1 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:38:02.368123 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-f7430fbe-890c-4a67-a532-62ef0a2e5df1 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:38:02.600836 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-f7430fbe-890c-4a67-a532-62ef0a2e5df1 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7489b29cb3ef47d78dfd55794f338b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065254ebe67545639644fcbc6bd9fc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:38:02.610518 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-f7430fbe-890c-4a67-a532-62ef0a2e5df1 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7489b29cb3ef47d78dfd55794f338b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065254ebe67545639644fcbc6bd9fc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:38:02.611986 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-f7430fbe-890c-4a67-a532-62ef0a2e5df1 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7489b29cb3ef47d78dfd55794f338b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065254ebe67545639644fcbc6bd9fc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:38:02.613195 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-f7430fbe-890c-4a67-a532-62ef0a2e5df1 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] 10.222.0.18 "GET /compute/v2.1/servers/72af7667-a283-4567-894f-2bd233c01001" status: 200 len: 1723 microversion: 2.20 time: 0.260620 Jun 24 16:38:02.613753 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 294/608] 10.222.0.18 () {60 vars in 1276 bytes} [Fri Jun 24 16:38:02 2022] GET /compute/v2.1/servers/72af7667-a283-4567-894f-2bd233c01001 => generated 1723 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 16:38:03.631899 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-2a708f89-ac76-4534-85f4-e7b2dccbe3cf tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Calling method '>' {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:38:03.632497 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-2a708f89-ac76-4534-85f4-e7b2dccbe3cf tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] [instance: 72af7667-a283-4567-894f-2bd233c01001] Fetching instance by UUID {{(pid=102148) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:38:03.641914 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-2a708f89-ac76-4534-85f4-e7b2dccbe3cf tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:38:03.642264 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-2a708f89-ac76-4534-85f4-e7b2dccbe3cf tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:38:03.643080 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-2a708f89-ac76-4534-85f4-e7b2dccbe3cf tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:38:03.643513 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-2a708f89-ac76-4534-85f4-e7b2dccbe3cf tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:38:03.880047 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-2a708f89-ac76-4534-85f4-e7b2dccbe3cf tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7489b29cb3ef47d78dfd55794f338b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065254ebe67545639644fcbc6bd9fc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:38:03.889532 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-2a708f89-ac76-4534-85f4-e7b2dccbe3cf tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7489b29cb3ef47d78dfd55794f338b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065254ebe67545639644fcbc6bd9fc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:38:03.891082 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-2a708f89-ac76-4534-85f4-e7b2dccbe3cf tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7489b29cb3ef47d78dfd55794f338b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065254ebe67545639644fcbc6bd9fc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:38:03.892416 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-2a708f89-ac76-4534-85f4-e7b2dccbe3cf tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] 10.222.0.18 "GET /compute/v2.1/servers/72af7667-a283-4567-894f-2bd233c01001" status: 200 len: 1723 microversion: 2.20 time: 0.264289 Jun 24 16:38:03.892909 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 315/609] 10.222.0.18 () {60 vars in 1276 bytes} [Fri Jun 24 16:38:03 2022] GET /compute/v2.1/servers/72af7667-a283-4567-894f-2bd233c01001 => generated 1723 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 16:38:04.546982 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-755dc297-bc9f-4be4-ab97-db280bef7acf tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Calling method '>' {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:38:04.547798 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-755dc297-bc9f-4be4-ab97-db280bef7acf tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] [instance: 2b6c814b-481d-4fba-8cd7-c84aee3f7572] Fetching instance by UUID {{(pid=102149) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:38:04.555954 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-755dc297-bc9f-4be4-ab97-db280bef7acf tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:38:04.556470 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-755dc297-bc9f-4be4-ab97-db280bef7acf tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:38:04.557348 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-755dc297-bc9f-4be4-ab97-db280bef7acf tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:38:04.557807 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-755dc297-bc9f-4be4-ab97-db280bef7acf tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:38:04.636396 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-755dc297-bc9f-4be4-ab97-db280bef7acf tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] [instance: 2b6c814b-481d-4fba-8cd7-c84aee3f7572] Going to try to terminate instance {{(pid=102149) delete /opt/stack/nova/nova/compute/api.py:2562}} Jun 24 16:38:04.761708 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-755dc297-bc9f-4be4-ab97-db280bef7acf tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] 10.222.0.18 "DELETE /compute/v2.1/servers/2b6c814b-481d-4fba-8cd7-c84aee3f7572" status: 204 len: 0 microversion: 2.1 time: 0.218240 Jun 24 16:38:04.762837 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 295/610] 10.222.0.18 () {58 vars in 1238 bytes} [Fri Jun 24 16:38:04 2022] DELETE /compute/v2.1/servers/2b6c814b-481d-4fba-8cd7-c84aee3f7572 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 24 16:38:04.774370 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-8e76c67f-2e33-481f-8bc0-9723371a5938 tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Calling method '>' {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:38:04.775463 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-8e76c67f-2e33-481f-8bc0-9723371a5938 tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] [instance: 2b6c814b-481d-4fba-8cd7-c84aee3f7572] Fetching instance by UUID {{(pid=102148) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:38:04.788899 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-8e76c67f-2e33-481f-8bc0-9723371a5938 tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:38:04.789712 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-8e76c67f-2e33-481f-8bc0-9723371a5938 tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:38:04.791028 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-8e76c67f-2e33-481f-8bc0-9723371a5938 tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:38:04.791682 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-8e76c67f-2e33-481f-8bc0-9723371a5938 tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:38:04.916855 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-49a7acdf-1bb6-4300-9231-6f875c66eeb4 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Calling method '>' {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:38:04.918883 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-49a7acdf-1bb6-4300-9231-6f875c66eeb4 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] [instance: 72af7667-a283-4567-894f-2bd233c01001] Fetching instance by UUID {{(pid=102149) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:38:04.930041 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-49a7acdf-1bb6-4300-9231-6f875c66eeb4 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:38:04.930487 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-49a7acdf-1bb6-4300-9231-6f875c66eeb4 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:38:04.932342 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-49a7acdf-1bb6-4300-9231-6f875c66eeb4 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:38:04.932848 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-49a7acdf-1bb6-4300-9231-6f875c66eeb4 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:38:05.095889 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-8e76c67f-2e33-481f-8bc0-9723371a5938 tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65d11cab328748d5a8f5e55eb439e334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901fbc33d59d49f8afa7f06d62e19e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:38:05.112423 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-8e76c67f-2e33-481f-8bc0-9723371a5938 tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] 10.222.0.18 "GET /compute/v2.1/servers/2b6c814b-481d-4fba-8cd7-c84aee3f7572" status: 200 len: 1576 microversion: 2.1 time: 0.342271 Jun 24 16:38:05.114825 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 316/611] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:38:04 2022] GET /compute/v2.1/servers/2b6c814b-481d-4fba-8cd7-c84aee3f7572 => generated 1576 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 16:38:05.191389 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-49a7acdf-1bb6-4300-9231-6f875c66eeb4 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7489b29cb3ef47d78dfd55794f338b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065254ebe67545639644fcbc6bd9fc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:38:05.201349 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-49a7acdf-1bb6-4300-9231-6f875c66eeb4 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7489b29cb3ef47d78dfd55794f338b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065254ebe67545639644fcbc6bd9fc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:38:05.202929 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-49a7acdf-1bb6-4300-9231-6f875c66eeb4 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7489b29cb3ef47d78dfd55794f338b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065254ebe67545639644fcbc6bd9fc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:38:05.204430 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-49a7acdf-1bb6-4300-9231-6f875c66eeb4 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] 10.222.0.18 "GET /compute/v2.1/servers/72af7667-a283-4567-894f-2bd233c01001" status: 200 len: 1723 microversion: 2.20 time: 0.295728 Jun 24 16:38:05.204984 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 296/612] 10.222.0.18 () {60 vars in 1276 bytes} [Fri Jun 24 16:38:04 2022] GET /compute/v2.1/servers/72af7667-a283-4567-894f-2bd233c01001 => generated 1723 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 16:38:06.132735 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-6dbb42a4-83c3-42d3-b969-ca920faa9fd9 tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Calling method '>' {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:38:06.133762 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-6dbb42a4-83c3-42d3-b969-ca920faa9fd9 tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] [instance: 2b6c814b-481d-4fba-8cd7-c84aee3f7572] Fetching instance by UUID {{(pid=102148) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:38:06.142643 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-6dbb42a4-83c3-42d3-b969-ca920faa9fd9 tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:38:06.143255 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-6dbb42a4-83c3-42d3-b969-ca920faa9fd9 tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:38:06.144271 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-6dbb42a4-83c3-42d3-b969-ca920faa9fd9 tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:38:06.144802 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-6dbb42a4-83c3-42d3-b969-ca920faa9fd9 tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:38:06.226222 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-0f049ec1-5bbf-411f-9821-4b56e55eb1de tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Calling method '>' {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:38:06.226918 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-0f049ec1-5bbf-411f-9821-4b56e55eb1de tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] [instance: 72af7667-a283-4567-894f-2bd233c01001] Fetching instance by UUID {{(pid=102149) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:38:06.234922 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-0f049ec1-5bbf-411f-9821-4b56e55eb1de tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:38:06.235364 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-0f049ec1-5bbf-411f-9821-4b56e55eb1de tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:38:06.236324 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-0f049ec1-5bbf-411f-9821-4b56e55eb1de tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:38:06.236750 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-0f049ec1-5bbf-411f-9821-4b56e55eb1de tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:38:06.499478 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-6dbb42a4-83c3-42d3-b969-ca920faa9fd9 tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65d11cab328748d5a8f5e55eb439e334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901fbc33d59d49f8afa7f06d62e19e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:38:06.510263 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-6dbb42a4-83c3-42d3-b969-ca920faa9fd9 tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] 10.222.0.18 "GET /compute/v2.1/servers/2b6c814b-481d-4fba-8cd7-c84aee3f7572" status: 200 len: 1576 microversion: 2.1 time: 0.382385 Jun 24 16:38:06.513652 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 317/613] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:38:06 2022] GET /compute/v2.1/servers/2b6c814b-481d-4fba-8cd7-c84aee3f7572 => generated 1576 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 16:38:06.684696 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-0f049ec1-5bbf-411f-9821-4b56e55eb1de tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7489b29cb3ef47d78dfd55794f338b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065254ebe67545639644fcbc6bd9fc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:38:06.694951 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-0f049ec1-5bbf-411f-9821-4b56e55eb1de tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7489b29cb3ef47d78dfd55794f338b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065254ebe67545639644fcbc6bd9fc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:38:06.696454 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-0f049ec1-5bbf-411f-9821-4b56e55eb1de tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7489b29cb3ef47d78dfd55794f338b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065254ebe67545639644fcbc6bd9fc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:38:06.697701 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-0f049ec1-5bbf-411f-9821-4b56e55eb1de tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] 10.222.0.18 "GET /compute/v2.1/servers/72af7667-a283-4567-894f-2bd233c01001" status: 200 len: 1723 microversion: 2.20 time: 0.476699 Jun 24 16:38:06.698303 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 297/614] 10.222.0.18 () {60 vars in 1276 bytes} [Fri Jun 24 16:38:06 2022] GET /compute/v2.1/servers/72af7667-a283-4567-894f-2bd233c01001 => generated 1723 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 16:38:07.529508 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-89029059-860d-4104-ab6e-16d2455620aa tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Calling method '>' {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:38:07.530415 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-89029059-860d-4104-ab6e-16d2455620aa tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] [instance: 2b6c814b-481d-4fba-8cd7-c84aee3f7572] Fetching instance by UUID {{(pid=102148) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:38:07.538425 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-89029059-860d-4104-ab6e-16d2455620aa tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:38:07.538896 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-89029059-860d-4104-ab6e-16d2455620aa tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:38:07.539876 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-89029059-860d-4104-ab6e-16d2455620aa tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:38:07.540313 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-89029059-860d-4104-ab6e-16d2455620aa tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:38:07.718182 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-8eeef572-403d-4e30-90ff-80fb2e1744ff tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Calling method '>' {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:38:07.719453 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-8eeef572-403d-4e30-90ff-80fb2e1744ff tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] [instance: 72af7667-a283-4567-894f-2bd233c01001] Fetching instance by UUID {{(pid=102149) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:38:07.730387 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-8eeef572-403d-4e30-90ff-80fb2e1744ff tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:38:07.731276 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-8eeef572-403d-4e30-90ff-80fb2e1744ff tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:38:07.732508 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-8eeef572-403d-4e30-90ff-80fb2e1744ff tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:38:07.733186 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-8eeef572-403d-4e30-90ff-80fb2e1744ff tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:38:07.804814 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-89029059-860d-4104-ab6e-16d2455620aa tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65d11cab328748d5a8f5e55eb439e334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901fbc33d59d49f8afa7f06d62e19e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:38:07.817738 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-89029059-860d-4104-ab6e-16d2455620aa tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] 10.222.0.18 "GET /compute/v2.1/servers/2b6c814b-481d-4fba-8cd7-c84aee3f7572" status: 200 len: 1576 microversion: 2.1 time: 0.291455 Jun 24 16:38:07.819686 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 318/615] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:38:07 2022] GET /compute/v2.1/servers/2b6c814b-481d-4fba-8cd7-c84aee3f7572 => generated 1576 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 16:38:08.123166 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-8eeef572-403d-4e30-90ff-80fb2e1744ff tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7489b29cb3ef47d78dfd55794f338b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065254ebe67545639644fcbc6bd9fc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:38:08.135978 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-8eeef572-403d-4e30-90ff-80fb2e1744ff tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7489b29cb3ef47d78dfd55794f338b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065254ebe67545639644fcbc6bd9fc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:38:08.139085 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-8eeef572-403d-4e30-90ff-80fb2e1744ff tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7489b29cb3ef47d78dfd55794f338b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065254ebe67545639644fcbc6bd9fc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:38:08.142223 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-8eeef572-403d-4e30-90ff-80fb2e1744ff tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] 10.222.0.18 "GET /compute/v2.1/servers/72af7667-a283-4567-894f-2bd233c01001" status: 200 len: 1723 microversion: 2.20 time: 0.428790 Jun 24 16:38:08.143204 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 298/616] 10.222.0.18 () {60 vars in 1276 bytes} [Fri Jun 24 16:38:07 2022] GET /compute/v2.1/servers/72af7667-a283-4567-894f-2bd233c01001 => generated 1723 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 16:38:08.539876 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [req-14f05c83-0b10-40ff-b53a-0b171e7c7309 req-cb3026be-2a52-452e-bf3a-923c19b2eef4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2b6c814b-481d-4fba-8cd7-c84aee3f7572", "name": "network-vif-deleted", "tag": "27aaebe5-51e8-49c2-8f07-e0e78f4459fd"}]} {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 16:38:08.542750 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 24 16:38:08.542750 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: warnings.warn(msg) Jun 24 16:38:08.553552 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [req-14f05c83-0b10-40ff-b53a-0b171e7c7309 req-cb3026be-2a52-452e-bf3a-923c19b2eef4 service nova] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:38:08.554360 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [req-14f05c83-0b10-40ff-b53a-0b171e7c7309 req-cb3026be-2a52-452e-bf3a-923c19b2eef4 service nova] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:38:08.589509 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.compute.server_external_events [req-14f05c83-0b10-40ff-b53a-0b171e7c7309 req-cb3026be-2a52-452e-bf3a-923c19b2eef4 service nova] Creating event network-vif-deleted:27aaebe5-51e8-49c2-8f07-e0e78f4459fd for instance 2b6c814b-481d-4fba-8cd7-c84aee3f7572 on hv-cinder-84718 Jun 24 16:38:08.595187 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [req-14f05c83-0b10-40ff-b53a-0b171e7c7309 req-cb3026be-2a52-452e-bf3a-923c19b2eef4 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060333 Jun 24 16:38:08.596643 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 319/617] 10.222.0.18 () {64 vars in 1317 bytes} [Fri Jun 24 16:38:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 16:38:08.843482 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-e581f168-ba33-4e95-a5d7-f0498ce44000 tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Calling method '>' {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:38:08.844962 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-e581f168-ba33-4e95-a5d7-f0498ce44000 tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] [instance: 2b6c814b-481d-4fba-8cd7-c84aee3f7572] Fetching instance by UUID {{(pid=102149) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:38:08.858937 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-e581f168-ba33-4e95-a5d7-f0498ce44000 tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:38:08.859630 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-e581f168-ba33-4e95-a5d7-f0498ce44000 tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:38:08.861099 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-e581f168-ba33-4e95-a5d7-f0498ce44000 tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:38:08.862299 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-e581f168-ba33-4e95-a5d7-f0498ce44000 tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:38:09.025376 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-e581f168-ba33-4e95-a5d7-f0498ce44000 tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65d11cab328748d5a8f5e55eb439e334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901fbc33d59d49f8afa7f06d62e19e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:38:09.040585 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-e581f168-ba33-4e95-a5d7-f0498ce44000 tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] 10.222.0.18 "GET /compute/v2.1/servers/2b6c814b-481d-4fba-8cd7-c84aee3f7572" status: 200 len: 1224 microversion: 2.1 time: 0.202842 Jun 24 16:38:09.041826 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 299/618] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:38:08 2022] GET /compute/v2.1/servers/2b6c814b-481d-4fba-8cd7-c84aee3f7572 => generated 1224 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 16:38:09.166854 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-3d7caaca-399f-46d2-a35f-e17c72c81196 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Calling method '>' {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:38:09.168747 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-3d7caaca-399f-46d2-a35f-e17c72c81196 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] [instance: 72af7667-a283-4567-894f-2bd233c01001] Fetching instance by UUID {{(pid=102148) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:38:09.183819 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-3d7caaca-399f-46d2-a35f-e17c72c81196 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:38:09.184564 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-3d7caaca-399f-46d2-a35f-e17c72c81196 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:38:09.186256 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-3d7caaca-399f-46d2-a35f-e17c72c81196 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:38:09.187018 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-3d7caaca-399f-46d2-a35f-e17c72c81196 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:38:09.492927 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-3d7caaca-399f-46d2-a35f-e17c72c81196 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7489b29cb3ef47d78dfd55794f338b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065254ebe67545639644fcbc6bd9fc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:38:09.511975 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-3d7caaca-399f-46d2-a35f-e17c72c81196 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7489b29cb3ef47d78dfd55794f338b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065254ebe67545639644fcbc6bd9fc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:38:09.516152 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-3d7caaca-399f-46d2-a35f-e17c72c81196 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7489b29cb3ef47d78dfd55794f338b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065254ebe67545639644fcbc6bd9fc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:38:09.519053 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-3d7caaca-399f-46d2-a35f-e17c72c81196 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] 10.222.0.18 "GET /compute/v2.1/servers/72af7667-a283-4567-894f-2bd233c01001" status: 200 len: 1723 microversion: 2.20 time: 0.359412 Jun 24 16:38:09.520049 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 320/619] 10.222.0.18 () {60 vars in 1276 bytes} [Fri Jun 24 16:38:09 2022] GET /compute/v2.1/servers/72af7667-a283-4567-894f-2bd233c01001 => generated 1723 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 16:38:10.057607 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-1b76bb8f-af56-437e-9e81-eeaf17a062c4 tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Calling method '>' {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:38:10.058209 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-1b76bb8f-af56-437e-9e81-eeaf17a062c4 tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] [instance: 2b6c814b-481d-4fba-8cd7-c84aee3f7572] Fetching instance by UUID {{(pid=102149) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:38:10.067464 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-1b76bb8f-af56-437e-9e81-eeaf17a062c4 tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:38:10.068150 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-1b76bb8f-af56-437e-9e81-eeaf17a062c4 tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:38:10.069278 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-1b76bb8f-af56-437e-9e81-eeaf17a062c4 tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:38:10.070024 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-1b76bb8f-af56-437e-9e81-eeaf17a062c4 tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:38:10.154080 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.wsgi [None req-1b76bb8f-af56-437e-9e81-eeaf17a062c4 tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] HTTP exception thrown: Instance 2b6c814b-481d-4fba-8cd7-c84aee3f7572 could not be found. Jun 24 16:38:10.155142 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-1b76bb8f-af56-437e-9e81-eeaf17a062c4 tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Returning 404 to user: Instance 2b6c814b-481d-4fba-8cd7-c84aee3f7572 could not be found. {{(pid=102149) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jun 24 16:38:10.156613 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-1b76bb8f-af56-437e-9e81-eeaf17a062c4 tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] 10.222.0.18 "GET /compute/v2.1/servers/2b6c814b-481d-4fba-8cd7-c84aee3f7572" status: 404 len: 111 microversion: 2.1 time: 0.102494 Jun 24 16:38:10.157610 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 300/620] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:38:10 2022] GET /compute/v2.1/servers/2b6c814b-481d-4fba-8cd7-c84aee3f7572 => generated 111 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 16:38:10.323253 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-9ee184b3-2714-4618-9bdd-894fa8d5c064 tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1650626660", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-306670203", "security_groups": [{"name": "tempest-secgroup-smoke-1405128976"}], "block_device_mapping_v2": [{"uuid": "87fd089a-edfc-453b-a4a7-c7b1dcc2ca55", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "e44350f6-4ad8-4a19-8963-bdb0aaadab4f"}]}} {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 16:38:10.537472 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.network.neutron [None req-9ee184b3-2714-4618-9bdd-894fa8d5c064 tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] validate_networks() for [('e44350f6-4ad8-4a19-8963-bdb0aaadab4f', None, None, None)] {{(pid=102148) validate_networks /opt/stack/nova/nova/network/neutron.py:2367}} Jun 24 16:38:10.538407 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-a7c79713-8668-49e7-be59-c409b0d6b6b1 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Calling method '>' {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:38:10.539237 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-a7c79713-8668-49e7-be59-c409b0d6b6b1 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] [instance: 72af7667-a283-4567-894f-2bd233c01001] Fetching instance by UUID {{(pid=102149) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:38:10.552260 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-a7c79713-8668-49e7-be59-c409b0d6b6b1 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:38:10.552702 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-a7c79713-8668-49e7-be59-c409b0d6b6b1 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:38:10.553535 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-a7c79713-8668-49e7-be59-c409b0d6b6b1 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:38:10.553923 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-a7c79713-8668-49e7-be59-c409b0d6b6b1 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:38:11.008403 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-a7c79713-8668-49e7-be59-c409b0d6b6b1 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7489b29cb3ef47d78dfd55794f338b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065254ebe67545639644fcbc6bd9fc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:38:11.030568 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-a7c79713-8668-49e7-be59-c409b0d6b6b1 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7489b29cb3ef47d78dfd55794f338b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065254ebe67545639644fcbc6bd9fc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:38:11.032627 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-a7c79713-8668-49e7-be59-c409b0d6b6b1 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7489b29cb3ef47d78dfd55794f338b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065254ebe67545639644fcbc6bd9fc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:38:11.033812 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-a7c79713-8668-49e7-be59-c409b0d6b6b1 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] 10.222.0.18 "GET /compute/v2.1/servers/72af7667-a283-4567-894f-2bd233c01001" status: 200 len: 1723 microversion: 2.20 time: 0.499097 Jun 24 16:38:11.034385 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 301/621] 10.222.0.18 () {60 vars in 1276 bytes} [Fri Jun 24 16:38:10 2022] GET /compute/v2.1/servers/72af7667-a283-4567-894f-2bd233c01001 => generated 1723 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 16:38:11.631872 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.virt.hardware [None req-9ee184b3-2714-4618-9bdd-894fa8d5c064 tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Flavor limits 0:0:0 {{(pid=102148) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 24 16:38:11.632466 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.virt.hardware [None req-9ee184b3-2714-4618-9bdd-894fa8d5c064 tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Image limits 0:0:0 {{(pid=102148) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 24 16:38:11.633003 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.virt.hardware [None req-9ee184b3-2714-4618-9bdd-894fa8d5c064 tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Flavor pref 0:0:0 {{(pid=102148) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 24 16:38:11.633247 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.virt.hardware [None req-9ee184b3-2714-4618-9bdd-894fa8d5c064 tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Image pref 0:0:0 {{(pid=102148) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 24 16:38:11.633983 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.virt.hardware [None req-9ee184b3-2714-4618-9bdd-894fa8d5c064 tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=102148) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 24 16:38:11.646500 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-9ee184b3-2714-4618-9bdd-894fa8d5c064 tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:38:11.647268 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-9ee184b3-2714-4618-9bdd-894fa8d5c064 tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:38:11.647798 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-9ee184b3-2714-4618-9bdd-894fa8d5c064 tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:38:11.648213 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-9ee184b3-2714-4618-9bdd-894fa8d5c064 tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:38:11.671784 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.quota [None req-9ee184b3-2714-4618-9bdd-894fa8d5c064 tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Getting quotas for project 901fbc33d59d49f8afa7f06d62e19e16. Resources: {'ram', 'instances', 'cores'} {{(pid=102148) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jun 24 16:38:11.676935 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.quota [None req-9ee184b3-2714-4618-9bdd-894fa8d5c064 tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Getting quotas for user 65d11cab328748d5a8f5e55eb439e334 and project 901fbc33d59d49f8afa7f06d62e19e16. Resources: {'ram', 'instances', 'cores'} {{(pid=102148) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jun 24 16:38:11.794992 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-9ee184b3-2714-4618-9bdd-894fa8d5c064 tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Going to run 1 instances... {{(pid=102148) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Jun 24 16:38:11.797369 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-9ee184b3-2714-4618-9bdd-894fa8d5c064 tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] [instance: acca3424-5f32-44c3-8c4c-fae78593ac50] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='87fd089a-edfc-453b-a4a7-c7b1dcc2ca55',volume_size=None,volume_type=None)] {{(pid=102148) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1684}} Jun 24 16:38:12.057746 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-1b31b12e-94a6-430d-b208-ce273637ad9c tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Calling method '>' {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:38:12.059556 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-9ee184b3-2714-4618-9bdd-894fa8d5c064 tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.744815 Jun 24 16:38:12.060331 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 321/622] 10.222.0.18 () {60 vars in 1146 bytes} [Fri Jun 24 16:38:10 2022] POST /compute/v2.1/servers => generated 406 bytes in 1746 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 24 16:38:12.060654 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-1b31b12e-94a6-430d-b208-ce273637ad9c tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] [instance: 72af7667-a283-4567-894f-2bd233c01001] Fetching instance by UUID {{(pid=102149) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:38:12.073504 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-ad6ed059-3b0a-4e43-885a-fedbdf24b1b4 tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Calling method '>' {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:38:12.074297 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-ad6ed059-3b0a-4e43-885a-fedbdf24b1b4 tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] [instance: acca3424-5f32-44c3-8c4c-fae78593ac50] Fetching instance by UUID {{(pid=102148) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:38:12.075185 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-1b31b12e-94a6-430d-b208-ce273637ad9c tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:38:12.076233 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-1b31b12e-94a6-430d-b208-ce273637ad9c tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:38:12.078222 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-1b31b12e-94a6-430d-b208-ce273637ad9c tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:38:12.080183 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-1b31b12e-94a6-430d-b208-ce273637ad9c tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:38:12.184502 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-ad6ed059-3b0a-4e43-885a-fedbdf24b1b4 tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65d11cab328748d5a8f5e55eb439e334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901fbc33d59d49f8afa7f06d62e19e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:38:12.198364 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-ad6ed059-3b0a-4e43-885a-fedbdf24b1b4 tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] 10.222.0.18 "GET /compute/v2.1/servers/acca3424-5f32-44c3-8c4c-fae78593ac50" status: 200 len: 1094 microversion: 2.1 time: 0.131525 Jun 24 16:38:12.200083 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 322/623] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:38:12 2022] GET /compute/v2.1/servers/acca3424-5f32-44c3-8c4c-fae78593ac50 => generated 1094 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 16:38:12.449134 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-1b31b12e-94a6-430d-b208-ce273637ad9c tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7489b29cb3ef47d78dfd55794f338b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065254ebe67545639644fcbc6bd9fc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:38:12.460827 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-1b31b12e-94a6-430d-b208-ce273637ad9c tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7489b29cb3ef47d78dfd55794f338b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065254ebe67545639644fcbc6bd9fc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:38:12.462407 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-1b31b12e-94a6-430d-b208-ce273637ad9c tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7489b29cb3ef47d78dfd55794f338b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065254ebe67545639644fcbc6bd9fc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:38:12.463788 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-1b31b12e-94a6-430d-b208-ce273637ad9c tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] 10.222.0.18 "GET /compute/v2.1/servers/72af7667-a283-4567-894f-2bd233c01001" status: 200 len: 1723 microversion: 2.20 time: 0.414596 Jun 24 16:38:12.475383 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 302/624] 10.222.0.18 () {60 vars in 1276 bytes} [Fri Jun 24 16:38:12 2022] GET /compute/v2.1/servers/72af7667-a283-4567-894f-2bd233c01001 => generated 1723 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 16:38:13.229610 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-8d420605-1f5e-42c1-baee-add6701620f7 tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Calling method '>' {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:38:13.230333 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-8d420605-1f5e-42c1-baee-add6701620f7 tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] [instance: acca3424-5f32-44c3-8c4c-fae78593ac50] Fetching instance by UUID {{(pid=102148) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:38:13.246011 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-8d420605-1f5e-42c1-baee-add6701620f7 tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:38:13.246883 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-8d420605-1f5e-42c1-baee-add6701620f7 tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:38:13.248562 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-8d420605-1f5e-42c1-baee-add6701620f7 tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:38:13.249868 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-8d420605-1f5e-42c1-baee-add6701620f7 tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:38:13.442447 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-8d420605-1f5e-42c1-baee-add6701620f7 tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65d11cab328748d5a8f5e55eb439e334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901fbc33d59d49f8afa7f06d62e19e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:38:13.463287 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-8d420605-1f5e-42c1-baee-add6701620f7 tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] 10.222.0.18 "GET /compute/v2.1/servers/acca3424-5f32-44c3-8c4c-fae78593ac50" status: 200 len: 1192 microversion: 2.1 time: 0.235918 Jun 24 16:38:13.464633 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 323/625] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:38:13 2022] GET /compute/v2.1/servers/acca3424-5f32-44c3-8c4c-fae78593ac50 => generated 1192 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 16:38:13.484153 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-5e607e0a-68fc-4378-a4f6-187d74e9b581 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Calling method '>' {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:38:13.485675 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-5e607e0a-68fc-4378-a4f6-187d74e9b581 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] [instance: 72af7667-a283-4567-894f-2bd233c01001] Fetching instance by UUID {{(pid=102149) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:38:13.498057 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-5e607e0a-68fc-4378-a4f6-187d74e9b581 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:38:13.498887 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-5e607e0a-68fc-4378-a4f6-187d74e9b581 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:38:13.499941 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-5e607e0a-68fc-4378-a4f6-187d74e9b581 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:38:13.500572 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-5e607e0a-68fc-4378-a4f6-187d74e9b581 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:38:13.937050 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-5e607e0a-68fc-4378-a4f6-187d74e9b581 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7489b29cb3ef47d78dfd55794f338b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065254ebe67545639644fcbc6bd9fc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:38:13.951485 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-5e607e0a-68fc-4378-a4f6-187d74e9b581 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7489b29cb3ef47d78dfd55794f338b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065254ebe67545639644fcbc6bd9fc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:38:13.953365 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-5e607e0a-68fc-4378-a4f6-187d74e9b581 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7489b29cb3ef47d78dfd55794f338b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065254ebe67545639644fcbc6bd9fc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:38:13.954867 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-5e607e0a-68fc-4378-a4f6-187d74e9b581 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] 10.222.0.18 "GET /compute/v2.1/servers/72af7667-a283-4567-894f-2bd233c01001" status: 200 len: 1723 microversion: 2.20 time: 0.474437 Jun 24 16:38:13.960155 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 303/626] 10.222.0.18 () {60 vars in 1276 bytes} [Fri Jun 24 16:38:13 2022] GET /compute/v2.1/servers/72af7667-a283-4567-894f-2bd233c01001 => generated 1723 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 16:38:14.487193 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-3a1a34d8-5f2f-4d2c-805e-030a126a1958 tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Calling method '>' {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:38:14.494564 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-3a1a34d8-5f2f-4d2c-805e-030a126a1958 tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] [instance: acca3424-5f32-44c3-8c4c-fae78593ac50] Fetching instance by UUID {{(pid=102148) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:38:14.515323 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-3a1a34d8-5f2f-4d2c-805e-030a126a1958 tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:38:14.516578 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-3a1a34d8-5f2f-4d2c-805e-030a126a1958 tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:38:14.518316 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-3a1a34d8-5f2f-4d2c-805e-030a126a1958 tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:38:14.519952 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-3a1a34d8-5f2f-4d2c-805e-030a126a1958 tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:38:14.954747 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-3a1a34d8-5f2f-4d2c-805e-030a126a1958 tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65d11cab328748d5a8f5e55eb439e334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901fbc33d59d49f8afa7f06d62e19e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:38:14.964606 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-3a1a34d8-5f2f-4d2c-805e-030a126a1958 tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] 10.222.0.18 "GET /compute/v2.1/servers/acca3424-5f32-44c3-8c4c-fae78593ac50" status: 200 len: 1278 microversion: 2.1 time: 0.485145 Jun 24 16:38:14.965185 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 324/627] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:38:14 2022] GET /compute/v2.1/servers/acca3424-5f32-44c3-8c4c-fae78593ac50 => generated 1278 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 16:38:14.990747 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-47d34464-cf17-481f-8f8b-271db4879a92 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Calling method '>' {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:38:14.991703 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-47d34464-cf17-481f-8f8b-271db4879a92 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] [instance: 72af7667-a283-4567-894f-2bd233c01001] Fetching instance by UUID {{(pid=102149) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:38:15.006612 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-47d34464-cf17-481f-8f8b-271db4879a92 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:38:15.007256 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-47d34464-cf17-481f-8f8b-271db4879a92 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:38:15.008353 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-47d34464-cf17-481f-8f8b-271db4879a92 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:38:15.008955 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-47d34464-cf17-481f-8f8b-271db4879a92 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:38:15.368105 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-47d34464-cf17-481f-8f8b-271db4879a92 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7489b29cb3ef47d78dfd55794f338b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065254ebe67545639644fcbc6bd9fc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:38:15.386848 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-47d34464-cf17-481f-8f8b-271db4879a92 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7489b29cb3ef47d78dfd55794f338b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065254ebe67545639644fcbc6bd9fc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:38:15.390340 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-47d34464-cf17-481f-8f8b-271db4879a92 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7489b29cb3ef47d78dfd55794f338b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065254ebe67545639644fcbc6bd9fc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:38:15.398848 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-47d34464-cf17-481f-8f8b-271db4879a92 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] 10.222.0.18 "GET /compute/v2.1/servers/72af7667-a283-4567-894f-2bd233c01001" status: 200 len: 1723 microversion: 2.20 time: 0.414295 Jun 24 16:38:15.400756 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 304/628] 10.222.0.18 () {60 vars in 1276 bytes} [Fri Jun 24 16:38:14 2022] GET /compute/v2.1/servers/72af7667-a283-4567-894f-2bd233c01001 => generated 1723 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 16:38:15.998871 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-acdf7e5d-9185-47ee-b61b-7c8e550038a8 tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Calling method '>' {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:38:15.999761 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-acdf7e5d-9185-47ee-b61b-7c8e550038a8 tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] [instance: acca3424-5f32-44c3-8c4c-fae78593ac50] Fetching instance by UUID {{(pid=102148) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:38:16.028037 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-acdf7e5d-9185-47ee-b61b-7c8e550038a8 tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:38:16.028487 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-acdf7e5d-9185-47ee-b61b-7c8e550038a8 tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:38:16.029724 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-acdf7e5d-9185-47ee-b61b-7c8e550038a8 tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:38:16.030332 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-acdf7e5d-9185-47ee-b61b-7c8e550038a8 tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:38:16.430809 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-67cd0c82-2b22-4a26-8984-ef5d6d2e08e6 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Calling method '>' {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:38:16.432406 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-67cd0c82-2b22-4a26-8984-ef5d6d2e08e6 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] [instance: 72af7667-a283-4567-894f-2bd233c01001] Fetching instance by UUID {{(pid=102149) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:38:16.455870 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-67cd0c82-2b22-4a26-8984-ef5d6d2e08e6 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:38:16.459652 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-67cd0c82-2b22-4a26-8984-ef5d6d2e08e6 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:38:16.461065 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-67cd0c82-2b22-4a26-8984-ef5d6d2e08e6 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:38:16.461799 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-67cd0c82-2b22-4a26-8984-ef5d6d2e08e6 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:38:16.466833 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-acdf7e5d-9185-47ee-b61b-7c8e550038a8 tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65d11cab328748d5a8f5e55eb439e334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901fbc33d59d49f8afa7f06d62e19e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:38:16.478859 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-acdf7e5d-9185-47ee-b61b-7c8e550038a8 tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] 10.222.0.18 "GET /compute/v2.1/servers/acca3424-5f32-44c3-8c4c-fae78593ac50" status: 200 len: 1266 microversion: 2.1 time: 0.492496 Jun 24 16:38:16.491140 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 325/629] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:38:15 2022] GET /compute/v2.1/servers/acca3424-5f32-44c3-8c4c-fae78593ac50 => generated 1266 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 16:38:16.631991 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [req-b77f8194-2b55-461e-908a-22b6015450c7 req-cdf71e7e-b840-46a8-a02f-f7c94be18fa6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "acca3424-5f32-44c3-8c4c-fae78593ac50", "tag": "50d5fc77-615e-4930-a0d1-7ba5a8aede09"}]} {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 16:38:16.639298 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 24 16:38:16.639298 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: warnings.warn(msg) Jun 24 16:38:16.664382 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [req-b77f8194-2b55-461e-908a-22b6015450c7 req-cdf71e7e-b840-46a8-a02f-f7c94be18fa6 service nova] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:38:16.664823 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [req-b77f8194-2b55-461e-908a-22b6015450c7 req-cdf71e7e-b840-46a8-a02f-f7c94be18fa6 service nova] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:38:16.715186 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.compute.server_external_events [req-b77f8194-2b55-461e-908a-22b6015450c7 req-cdf71e7e-b840-46a8-a02f-f7c94be18fa6 service nova] Creating event network-changed:50d5fc77-615e-4930-a0d1-7ba5a8aede09 for instance acca3424-5f32-44c3-8c4c-fae78593ac50 on hv-cinder-84718 Jun 24 16:38:16.724452 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [req-b77f8194-2b55-461e-908a-22b6015450c7 req-cdf71e7e-b840-46a8-a02f-f7c94be18fa6 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098113 Jun 24 16:38:16.725781 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 326/630] 10.222.0.18 () {64 vars in 1317 bytes} [Fri Jun 24 16:38:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 16:38:16.881046 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-67cd0c82-2b22-4a26-8984-ef5d6d2e08e6 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7489b29cb3ef47d78dfd55794f338b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065254ebe67545639644fcbc6bd9fc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:38:16.890866 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-67cd0c82-2b22-4a26-8984-ef5d6d2e08e6 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7489b29cb3ef47d78dfd55794f338b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065254ebe67545639644fcbc6bd9fc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:38:16.892378 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-67cd0c82-2b22-4a26-8984-ef5d6d2e08e6 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7489b29cb3ef47d78dfd55794f338b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065254ebe67545639644fcbc6bd9fc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:38:16.894339 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-67cd0c82-2b22-4a26-8984-ef5d6d2e08e6 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] 10.222.0.18 "GET /compute/v2.1/servers/72af7667-a283-4567-894f-2bd233c01001" status: 200 len: 1744 microversion: 2.20 time: 0.467507 Jun 24 16:38:16.895159 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 305/631] 10.222.0.18 () {60 vars in 1276 bytes} [Fri Jun 24 16:38:16 2022] GET /compute/v2.1/servers/72af7667-a283-4567-894f-2bd233c01001 => generated 1744 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 16:38:17.502637 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-1442a559-d3f4-437f-8efd-42e8ec3a498b tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Calling method '>' {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:38:17.503970 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-1442a559-d3f4-437f-8efd-42e8ec3a498b tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] [instance: acca3424-5f32-44c3-8c4c-fae78593ac50] Fetching instance by UUID {{(pid=102148) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:38:17.515689 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-1442a559-d3f4-437f-8efd-42e8ec3a498b tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:38:17.516411 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-1442a559-d3f4-437f-8efd-42e8ec3a498b tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:38:17.517405 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-1442a559-d3f4-437f-8efd-42e8ec3a498b tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:38:17.518635 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-1442a559-d3f4-437f-8efd-42e8ec3a498b tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:38:17.851273 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-1442a559-d3f4-437f-8efd-42e8ec3a498b tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65d11cab328748d5a8f5e55eb439e334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901fbc33d59d49f8afa7f06d62e19e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:38:17.872495 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-1442a559-d3f4-437f-8efd-42e8ec3a498b tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] 10.222.0.18 "GET /compute/v2.1/servers/acca3424-5f32-44c3-8c4c-fae78593ac50" status: 200 len: 1266 microversion: 2.1 time: 0.375539 Jun 24 16:38:17.883118 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 327/632] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:38:17 2022] GET /compute/v2.1/servers/acca3424-5f32-44c3-8c4c-fae78593ac50 => generated 1266 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 16:38:17.918176 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-65018eb7-a980-47c4-9ef9-26ba07f6dd5e tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Calling method '>' {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:38:17.921578 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-65018eb7-a980-47c4-9ef9-26ba07f6dd5e tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] [instance: 72af7667-a283-4567-894f-2bd233c01001] Fetching instance by UUID {{(pid=102149) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:38:17.937890 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [req-cedca1da-8e34-4135-84a7-f00640ed32cf req-17e4e12f-886e-4733-80c3-337dacde2c6d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "72af7667-a283-4567-894f-2bd233c01001", "name": "network-vif-plugged", "status": "completed", "tag": "87b332d5-d83a-40ca-bb6b-503444dbbfbe"}]} {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 16:38:17.939612 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 24 16:38:17.939612 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: warnings.warn(msg) Jun 24 16:38:17.957965 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [req-cedca1da-8e34-4135-84a7-f00640ed32cf req-17e4e12f-886e-4733-80c3-337dacde2c6d service nova] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:38:17.958410 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [req-cedca1da-8e34-4135-84a7-f00640ed32cf req-17e4e12f-886e-4733-80c3-337dacde2c6d service nova] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:38:17.961315 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-65018eb7-a980-47c4-9ef9-26ba07f6dd5e tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:38:17.962060 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-65018eb7-a980-47c4-9ef9-26ba07f6dd5e tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:38:17.963094 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-65018eb7-a980-47c4-9ef9-26ba07f6dd5e tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:38:17.963776 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-65018eb7-a980-47c4-9ef9-26ba07f6dd5e tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:38:18.026104 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.compute.server_external_events [req-cedca1da-8e34-4135-84a7-f00640ed32cf req-17e4e12f-886e-4733-80c3-337dacde2c6d service nova] Creating event network-vif-plugged:87b332d5-d83a-40ca-bb6b-503444dbbfbe for instance 72af7667-a283-4567-894f-2bd233c01001 on hv-cinder-84718 Jun 24 16:38:18.039400 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [req-cedca1da-8e34-4135-84a7-f00640ed32cf req-17e4e12f-886e-4733-80c3-337dacde2c6d service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106124 Jun 24 16:38:18.040013 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 328/633] 10.222.0.18 () {64 vars in 1317 bytes} [Fri Jun 24 16:38:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 16:38:18.385539 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-65018eb7-a980-47c4-9ef9-26ba07f6dd5e tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7489b29cb3ef47d78dfd55794f338b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065254ebe67545639644fcbc6bd9fc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:38:18.422579 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-65018eb7-a980-47c4-9ef9-26ba07f6dd5e tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7489b29cb3ef47d78dfd55794f338b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065254ebe67545639644fcbc6bd9fc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:38:18.427791 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-65018eb7-a980-47c4-9ef9-26ba07f6dd5e tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7489b29cb3ef47d78dfd55794f338b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065254ebe67545639644fcbc6bd9fc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:38:18.433078 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-65018eb7-a980-47c4-9ef9-26ba07f6dd5e tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] 10.222.0.18 "GET /compute/v2.1/servers/72af7667-a283-4567-894f-2bd233c01001" status: 200 len: 1739 microversion: 2.20 time: 0.522274 Jun 24 16:38:18.445030 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 306/634] 10.222.0.18 () {60 vars in 1276 bytes} [Fri Jun 24 16:38:17 2022] GET /compute/v2.1/servers/72af7667-a283-4567-894f-2bd233c01001 => generated 1739 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 16:38:18.899769 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-09b3b4de-636f-49ba-82a2-b53d9a99f4af tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Calling method '>' {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:38:18.900475 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-09b3b4de-636f-49ba-82a2-b53d9a99f4af tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] [instance: acca3424-5f32-44c3-8c4c-fae78593ac50] Fetching instance by UUID {{(pid=102148) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:38:18.917165 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-09b3b4de-636f-49ba-82a2-b53d9a99f4af tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:38:18.917868 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-09b3b4de-636f-49ba-82a2-b53d9a99f4af tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:38:18.918938 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-09b3b4de-636f-49ba-82a2-b53d9a99f4af tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:38:18.919836 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-09b3b4de-636f-49ba-82a2-b53d9a99f4af tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:38:19.250068 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-09b3b4de-636f-49ba-82a2-b53d9a99f4af tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65d11cab328748d5a8f5e55eb439e334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901fbc33d59d49f8afa7f06d62e19e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:38:19.266611 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-09b3b4de-636f-49ba-82a2-b53d9a99f4af tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] 10.222.0.18 "GET /compute/v2.1/servers/acca3424-5f32-44c3-8c4c-fae78593ac50" status: 200 len: 1266 microversion: 2.1 time: 0.371414 Jun 24 16:38:19.267229 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 329/635] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:38:18 2022] GET /compute/v2.1/servers/acca3424-5f32-44c3-8c4c-fae78593ac50 => generated 1266 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 16:38:19.489134 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-55a7d25e-fd8e-47e7-b2b0-18f43d709da8 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Calling method '>' {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:38:19.490518 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-55a7d25e-fd8e-47e7-b2b0-18f43d709da8 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] [instance: 72af7667-a283-4567-894f-2bd233c01001] Fetching instance by UUID {{(pid=102149) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:38:19.498580 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-55a7d25e-fd8e-47e7-b2b0-18f43d709da8 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:38:19.499382 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-55a7d25e-fd8e-47e7-b2b0-18f43d709da8 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:38:19.500351 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-55a7d25e-fd8e-47e7-b2b0-18f43d709da8 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:38:19.500896 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-55a7d25e-fd8e-47e7-b2b0-18f43d709da8 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:38:19.754766 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-55a7d25e-fd8e-47e7-b2b0-18f43d709da8 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7489b29cb3ef47d78dfd55794f338b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065254ebe67545639644fcbc6bd9fc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:38:19.764945 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-55a7d25e-fd8e-47e7-b2b0-18f43d709da8 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7489b29cb3ef47d78dfd55794f338b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065254ebe67545639644fcbc6bd9fc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:38:19.767132 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-55a7d25e-fd8e-47e7-b2b0-18f43d709da8 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7489b29cb3ef47d78dfd55794f338b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065254ebe67545639644fcbc6bd9fc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:38:19.769934 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-55a7d25e-fd8e-47e7-b2b0-18f43d709da8 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] 10.222.0.18 "GET /compute/v2.1/servers/72af7667-a283-4567-894f-2bd233c01001" status: 200 len: 1739 microversion: 2.20 time: 0.289535 Jun 24 16:38:19.771213 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 307/636] 10.222.0.18 () {60 vars in 1276 bytes} [Fri Jun 24 16:38:19 2022] GET /compute/v2.1/servers/72af7667-a283-4567-894f-2bd233c01001 => generated 1739 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 16:38:20.294959 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-ff374b69-ff88-4104-97c5-25941f0c276f tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Calling method '>' {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:38:20.296339 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-ff374b69-ff88-4104-97c5-25941f0c276f tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] [instance: acca3424-5f32-44c3-8c4c-fae78593ac50] Fetching instance by UUID {{(pid=102148) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:38:20.310605 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-ff374b69-ff88-4104-97c5-25941f0c276f tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:38:20.311996 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-ff374b69-ff88-4104-97c5-25941f0c276f tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:38:20.313515 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-ff374b69-ff88-4104-97c5-25941f0c276f tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:38:20.314416 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-ff374b69-ff88-4104-97c5-25941f0c276f tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:38:20.625257 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-ff374b69-ff88-4104-97c5-25941f0c276f tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65d11cab328748d5a8f5e55eb439e334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901fbc33d59d49f8afa7f06d62e19e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:38:20.635767 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-ff374b69-ff88-4104-97c5-25941f0c276f tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] 10.222.0.18 "GET /compute/v2.1/servers/acca3424-5f32-44c3-8c4c-fae78593ac50" status: 200 len: 1266 microversion: 2.1 time: 0.345592 Jun 24 16:38:20.646091 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 330/637] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:38:20 2022] GET /compute/v2.1/servers/acca3424-5f32-44c3-8c4c-fae78593ac50 => generated 1266 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 16:38:20.790702 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-c65e592a-0685-4fbd-b588-49f7e07a35e6 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Calling method '>' {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:38:20.791531 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-c65e592a-0685-4fbd-b588-49f7e07a35e6 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] [instance: 72af7667-a283-4567-894f-2bd233c01001] Fetching instance by UUID {{(pid=102149) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:38:20.801523 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-c65e592a-0685-4fbd-b588-49f7e07a35e6 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:38:20.801798 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-c65e592a-0685-4fbd-b588-49f7e07a35e6 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:38:20.802660 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-c65e592a-0685-4fbd-b588-49f7e07a35e6 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:38:20.803378 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-c65e592a-0685-4fbd-b588-49f7e07a35e6 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:38:21.109560 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-c65e592a-0685-4fbd-b588-49f7e07a35e6 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7489b29cb3ef47d78dfd55794f338b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065254ebe67545639644fcbc6bd9fc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:38:21.127886 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-c65e592a-0685-4fbd-b588-49f7e07a35e6 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7489b29cb3ef47d78dfd55794f338b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065254ebe67545639644fcbc6bd9fc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:38:21.129830 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-c65e592a-0685-4fbd-b588-49f7e07a35e6 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7489b29cb3ef47d78dfd55794f338b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065254ebe67545639644fcbc6bd9fc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:38:21.131769 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-c65e592a-0685-4fbd-b588-49f7e07a35e6 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] 10.222.0.18 "GET /compute/v2.1/servers/72af7667-a283-4567-894f-2bd233c01001" status: 200 len: 1739 microversion: 2.20 time: 0.345883 Jun 24 16:38:21.132544 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 308/638] 10.222.0.18 () {60 vars in 1276 bytes} [Fri Jun 24 16:38:20 2022] GET /compute/v2.1/servers/72af7667-a283-4567-894f-2bd233c01001 => generated 1739 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 16:38:21.657075 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-8d308262-684a-499b-b74f-e1cd5723f06d tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Calling method '>' {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:38:21.659764 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-8d308262-684a-499b-b74f-e1cd5723f06d tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] [instance: acca3424-5f32-44c3-8c4c-fae78593ac50] Fetching instance by UUID {{(pid=102148) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:38:21.679848 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-8d308262-684a-499b-b74f-e1cd5723f06d tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:38:21.681157 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-8d308262-684a-499b-b74f-e1cd5723f06d tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:38:21.682763 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-8d308262-684a-499b-b74f-e1cd5723f06d tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:38:21.684669 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-8d308262-684a-499b-b74f-e1cd5723f06d tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:38:22.152669 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-b8bf57cb-1bc3-4c8f-a10f-77c9d1dbee0b tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Calling method '>' {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:38:22.153524 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-b8bf57cb-1bc3-4c8f-a10f-77c9d1dbee0b tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] [instance: 72af7667-a283-4567-894f-2bd233c01001] Fetching instance by UUID {{(pid=102149) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:38:22.167451 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-b8bf57cb-1bc3-4c8f-a10f-77c9d1dbee0b tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:38:22.172811 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-b8bf57cb-1bc3-4c8f-a10f-77c9d1dbee0b tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:38:22.173924 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-b8bf57cb-1bc3-4c8f-a10f-77c9d1dbee0b tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:38:22.174544 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-b8bf57cb-1bc3-4c8f-a10f-77c9d1dbee0b tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:38:22.220634 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-8d308262-684a-499b-b74f-e1cd5723f06d tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65d11cab328748d5a8f5e55eb439e334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901fbc33d59d49f8afa7f06d62e19e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:38:22.232925 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-8d308262-684a-499b-b74f-e1cd5723f06d tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] 10.222.0.18 "GET /compute/v2.1/servers/acca3424-5f32-44c3-8c4c-fae78593ac50" status: 200 len: 1266 microversion: 2.1 time: 0.581867 Jun 24 16:38:22.233566 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 331/639] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:38:21 2022] GET /compute/v2.1/servers/acca3424-5f32-44c3-8c4c-fae78593ac50 => generated 1266 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 16:38:22.704590 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-b8bf57cb-1bc3-4c8f-a10f-77c9d1dbee0b tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7489b29cb3ef47d78dfd55794f338b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065254ebe67545639644fcbc6bd9fc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:38:22.720417 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-b8bf57cb-1bc3-4c8f-a10f-77c9d1dbee0b tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7489b29cb3ef47d78dfd55794f338b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065254ebe67545639644fcbc6bd9fc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:38:22.722798 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-b8bf57cb-1bc3-4c8f-a10f-77c9d1dbee0b tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7489b29cb3ef47d78dfd55794f338b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065254ebe67545639644fcbc6bd9fc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:38:22.723987 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-b8bf57cb-1bc3-4c8f-a10f-77c9d1dbee0b tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] 10.222.0.18 "GET /compute/v2.1/servers/72af7667-a283-4567-894f-2bd233c01001" status: 200 len: 1739 microversion: 2.20 time: 0.576031 Jun 24 16:38:22.726575 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 309/640] 10.222.0.18 () {60 vars in 1276 bytes} [Fri Jun 24 16:38:22 2022] GET /compute/v2.1/servers/72af7667-a283-4567-894f-2bd233c01001 => generated 1739 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 16:38:23.254130 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-13b069c2-5429-4d69-8d70-5b1cf254f226 tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Calling method '>' {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:38:23.255376 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-13b069c2-5429-4d69-8d70-5b1cf254f226 tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] [instance: acca3424-5f32-44c3-8c4c-fae78593ac50] Fetching instance by UUID {{(pid=102148) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:38:23.270075 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-13b069c2-5429-4d69-8d70-5b1cf254f226 tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:38:23.271238 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-13b069c2-5429-4d69-8d70-5b1cf254f226 tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:38:23.273410 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-13b069c2-5429-4d69-8d70-5b1cf254f226 tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:38:23.274181 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-13b069c2-5429-4d69-8d70-5b1cf254f226 tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:38:23.748675 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-c132317a-1afb-4570-9a4b-3d2bb1fc9a3c tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Calling method '>' {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:38:23.754365 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-c132317a-1afb-4570-9a4b-3d2bb1fc9a3c tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] [instance: 72af7667-a283-4567-894f-2bd233c01001] Fetching instance by UUID {{(pid=102149) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:38:23.793675 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-c132317a-1afb-4570-9a4b-3d2bb1fc9a3c tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:38:23.795680 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-c132317a-1afb-4570-9a4b-3d2bb1fc9a3c tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:38:23.799376 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-c132317a-1afb-4570-9a4b-3d2bb1fc9a3c tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:38:23.800659 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-c132317a-1afb-4570-9a4b-3d2bb1fc9a3c tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:38:24.061129 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-13b069c2-5429-4d69-8d70-5b1cf254f226 tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65d11cab328748d5a8f5e55eb439e334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901fbc33d59d49f8afa7f06d62e19e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:38:24.078024 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-13b069c2-5429-4d69-8d70-5b1cf254f226 tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] 10.222.0.18 "GET /compute/v2.1/servers/acca3424-5f32-44c3-8c4c-fae78593ac50" status: 200 len: 1266 microversion: 2.1 time: 0.829926 Jun 24 16:38:24.079711 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 332/641] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:38:23 2022] GET /compute/v2.1/servers/acca3424-5f32-44c3-8c4c-fae78593ac50 => generated 1266 bytes in 833 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 16:38:24.209679 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-c132317a-1afb-4570-9a4b-3d2bb1fc9a3c tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7489b29cb3ef47d78dfd55794f338b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065254ebe67545639644fcbc6bd9fc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:38:24.225925 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-c132317a-1afb-4570-9a4b-3d2bb1fc9a3c tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7489b29cb3ef47d78dfd55794f338b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065254ebe67545639644fcbc6bd9fc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:38:24.232465 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-c132317a-1afb-4570-9a4b-3d2bb1fc9a3c tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7489b29cb3ef47d78dfd55794f338b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065254ebe67545639644fcbc6bd9fc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:38:24.233946 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-c132317a-1afb-4570-9a4b-3d2bb1fc9a3c tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] 10.222.0.18 "GET /compute/v2.1/servers/72af7667-a283-4567-894f-2bd233c01001" status: 200 len: 1739 microversion: 2.20 time: 0.494196 Jun 24 16:38:24.234535 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 310/642] 10.222.0.18 () {60 vars in 1276 bytes} [Fri Jun 24 16:38:23 2022] GET /compute/v2.1/servers/72af7667-a283-4567-894f-2bd233c01001 => generated 1739 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 16:38:25.101861 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-ade8fd0c-1ebb-4d41-bbad-4500456ec415 tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Calling method '>' {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:38:25.103189 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-ade8fd0c-1ebb-4d41-bbad-4500456ec415 tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] [instance: acca3424-5f32-44c3-8c4c-fae78593ac50] Fetching instance by UUID {{(pid=102148) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:38:25.111409 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-ade8fd0c-1ebb-4d41-bbad-4500456ec415 tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:38:25.112214 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-ade8fd0c-1ebb-4d41-bbad-4500456ec415 tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:38:25.113017 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-ade8fd0c-1ebb-4d41-bbad-4500456ec415 tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:38:25.113457 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-ade8fd0c-1ebb-4d41-bbad-4500456ec415 tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:38:25.254780 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-17a9b4fc-5ec3-4360-8a09-b4a95472171c tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Calling method '>' {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:38:25.255541 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-17a9b4fc-5ec3-4360-8a09-b4a95472171c tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] [instance: 72af7667-a283-4567-894f-2bd233c01001] Fetching instance by UUID {{(pid=102149) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:38:25.269959 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-17a9b4fc-5ec3-4360-8a09-b4a95472171c tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:38:25.270420 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-17a9b4fc-5ec3-4360-8a09-b4a95472171c tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:38:25.271315 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-17a9b4fc-5ec3-4360-8a09-b4a95472171c tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:38:25.271747 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-17a9b4fc-5ec3-4360-8a09-b4a95472171c tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:38:25.476840 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-ade8fd0c-1ebb-4d41-bbad-4500456ec415 tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65d11cab328748d5a8f5e55eb439e334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901fbc33d59d49f8afa7f06d62e19e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:38:25.485992 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-ade8fd0c-1ebb-4d41-bbad-4500456ec415 tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] 10.222.0.18 "GET /compute/v2.1/servers/acca3424-5f32-44c3-8c4c-fae78593ac50" status: 200 len: 1266 microversion: 2.1 time: 0.387654 Jun 24 16:38:25.499830 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 333/643] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:38:25 2022] GET /compute/v2.1/servers/acca3424-5f32-44c3-8c4c-fae78593ac50 => generated 1266 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 16:38:25.610018 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-17a9b4fc-5ec3-4360-8a09-b4a95472171c tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7489b29cb3ef47d78dfd55794f338b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065254ebe67545639644fcbc6bd9fc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:38:25.626211 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-17a9b4fc-5ec3-4360-8a09-b4a95472171c tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7489b29cb3ef47d78dfd55794f338b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065254ebe67545639644fcbc6bd9fc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:38:25.628748 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-17a9b4fc-5ec3-4360-8a09-b4a95472171c tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7489b29cb3ef47d78dfd55794f338b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065254ebe67545639644fcbc6bd9fc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:38:25.632996 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-17a9b4fc-5ec3-4360-8a09-b4a95472171c tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] 10.222.0.18 "GET /compute/v2.1/servers/72af7667-a283-4567-894f-2bd233c01001" status: 200 len: 1739 microversion: 2.20 time: 0.382379 Jun 24 16:38:25.650123 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 311/644] 10.222.0.18 () {60 vars in 1276 bytes} [Fri Jun 24 16:38:25 2022] GET /compute/v2.1/servers/72af7667-a283-4567-894f-2bd233c01001 => generated 1739 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 16:38:25.939141 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [req-aac4950b-4ce0-4e1c-b45e-17b8c3fbb06a req-31dee384-70ba-4d92-8646-46a54afbe60c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "acca3424-5f32-44c3-8c4c-fae78593ac50", "name": "network-vif-plugged", "status": "completed", "tag": "50d5fc77-615e-4930-a0d1-7ba5a8aede09"}]} {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 16:38:25.941905 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 24 16:38:25.941905 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: warnings.warn(msg) Jun 24 16:38:25.951619 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [req-aac4950b-4ce0-4e1c-b45e-17b8c3fbb06a req-31dee384-70ba-4d92-8646-46a54afbe60c service nova] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:38:25.952767 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [req-aac4950b-4ce0-4e1c-b45e-17b8c3fbb06a req-31dee384-70ba-4d92-8646-46a54afbe60c service nova] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:38:25.978502 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.compute.server_external_events [req-aac4950b-4ce0-4e1c-b45e-17b8c3fbb06a req-31dee384-70ba-4d92-8646-46a54afbe60c service nova] Creating event network-vif-plugged:50d5fc77-615e-4930-a0d1-7ba5a8aede09 for instance acca3424-5f32-44c3-8c4c-fae78593ac50 on hv-cinder-84718 Jun 24 16:38:25.985659 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [req-aac4950b-4ce0-4e1c-b45e-17b8c3fbb06a req-31dee384-70ba-4d92-8646-46a54afbe60c service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051801 Jun 24 16:38:25.986407 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 334/645] 10.222.0.18 () {64 vars in 1317 bytes} [Fri Jun 24 16:38:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 16:38:26.506308 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-0c28f148-f63b-40ea-a035-dc8dda9a449d tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Calling method '>' {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:38:26.507035 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-0c28f148-f63b-40ea-a035-dc8dda9a449d tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] [instance: acca3424-5f32-44c3-8c4c-fae78593ac50] Fetching instance by UUID {{(pid=102149) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:38:26.518426 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-0c28f148-f63b-40ea-a035-dc8dda9a449d tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:38:26.518917 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-0c28f148-f63b-40ea-a035-dc8dda9a449d tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:38:26.519709 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-0c28f148-f63b-40ea-a035-dc8dda9a449d tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:38:26.520145 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-0c28f148-f63b-40ea-a035-dc8dda9a449d tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:38:26.658216 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-a0f39e2f-d61c-497b-bae7-0d205d7e6499 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Calling method '>' {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:38:26.660177 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-a0f39e2f-d61c-497b-bae7-0d205d7e6499 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] [instance: 72af7667-a283-4567-894f-2bd233c01001] Fetching instance by UUID {{(pid=102148) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:38:26.675471 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-a0f39e2f-d61c-497b-bae7-0d205d7e6499 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:38:26.676143 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-a0f39e2f-d61c-497b-bae7-0d205d7e6499 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:38:26.677117 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-a0f39e2f-d61c-497b-bae7-0d205d7e6499 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:38:26.677850 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-a0f39e2f-d61c-497b-bae7-0d205d7e6499 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:38:26.907493 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-0c28f148-f63b-40ea-a035-dc8dda9a449d tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65d11cab328748d5a8f5e55eb439e334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901fbc33d59d49f8afa7f06d62e19e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:38:26.920069 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-0c28f148-f63b-40ea-a035-dc8dda9a449d tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] 10.222.0.18 "GET /compute/v2.1/servers/acca3424-5f32-44c3-8c4c-fae78593ac50" status: 200 len: 1266 microversion: 2.1 time: 0.418264 Jun 24 16:38:26.934218 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 312/646] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:38:26 2022] GET /compute/v2.1/servers/acca3424-5f32-44c3-8c4c-fae78593ac50 => generated 1266 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 16:38:27.030488 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-a0f39e2f-d61c-497b-bae7-0d205d7e6499 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7489b29cb3ef47d78dfd55794f338b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065254ebe67545639644fcbc6bd9fc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:38:27.041320 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-a0f39e2f-d61c-497b-bae7-0d205d7e6499 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7489b29cb3ef47d78dfd55794f338b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065254ebe67545639644fcbc6bd9fc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:38:27.043093 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-a0f39e2f-d61c-497b-bae7-0d205d7e6499 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7489b29cb3ef47d78dfd55794f338b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065254ebe67545639644fcbc6bd9fc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:38:27.044017 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-a0f39e2f-d61c-497b-bae7-0d205d7e6499 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] 10.222.0.18 "GET /compute/v2.1/servers/72af7667-a283-4567-894f-2bd233c01001" status: 200 len: 1739 microversion: 2.20 time: 0.390430 Jun 24 16:38:27.058516 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 335/647] 10.222.0.18 () {60 vars in 1276 bytes} [Fri Jun 24 16:38:26 2022] GET /compute/v2.1/servers/72af7667-a283-4567-894f-2bd233c01001 => generated 1739 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 16:38:27.944341 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-85d445c7-500f-40e3-bcf3-7dfaf58f70c0 tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Calling method '>' {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:38:27.945417 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-85d445c7-500f-40e3-bcf3-7dfaf58f70c0 tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] [instance: acca3424-5f32-44c3-8c4c-fae78593ac50] Fetching instance by UUID {{(pid=102149) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:38:27.987415 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-85d445c7-500f-40e3-bcf3-7dfaf58f70c0 tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:38:27.988477 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-85d445c7-500f-40e3-bcf3-7dfaf58f70c0 tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:38:27.990137 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-85d445c7-500f-40e3-bcf3-7dfaf58f70c0 tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:38:27.991129 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-85d445c7-500f-40e3-bcf3-7dfaf58f70c0 tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:38:28.062309 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-9d3e445f-d3d0-4b8e-b868-4d4090f779e2 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Calling method '>' {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:38:28.063784 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-9d3e445f-d3d0-4b8e-b868-4d4090f779e2 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] [instance: 72af7667-a283-4567-894f-2bd233c01001] Fetching instance by UUID {{(pid=102148) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:38:28.073130 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-9d3e445f-d3d0-4b8e-b868-4d4090f779e2 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:38:28.073985 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-9d3e445f-d3d0-4b8e-b868-4d4090f779e2 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:38:28.075023 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-9d3e445f-d3d0-4b8e-b868-4d4090f779e2 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:38:28.075633 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-9d3e445f-d3d0-4b8e-b868-4d4090f779e2 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:38:28.664606 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-85d445c7-500f-40e3-bcf3-7dfaf58f70c0 tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65d11cab328748d5a8f5e55eb439e334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901fbc33d59d49f8afa7f06d62e19e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:38:28.677616 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-9d3e445f-d3d0-4b8e-b868-4d4090f779e2 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7489b29cb3ef47d78dfd55794f338b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065254ebe67545639644fcbc6bd9fc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:38:28.698626 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-9d3e445f-d3d0-4b8e-b868-4d4090f779e2 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7489b29cb3ef47d78dfd55794f338b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065254ebe67545639644fcbc6bd9fc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:38:28.700508 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-85d445c7-500f-40e3-bcf3-7dfaf58f70c0 tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] 10.222.0.18 "GET /compute/v2.1/servers/acca3424-5f32-44c3-8c4c-fae78593ac50" status: 200 len: 1452 microversion: 2.1 time: 0.758052 Jun 24 16:38:28.713774 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 313/648] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:38:27 2022] GET /compute/v2.1/servers/acca3424-5f32-44c3-8c4c-fae78593ac50 => generated 1452 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 16:38:28.714153 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-9d3e445f-d3d0-4b8e-b868-4d4090f779e2 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7489b29cb3ef47d78dfd55794f338b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065254ebe67545639644fcbc6bd9fc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:38:28.715826 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-9d3e445f-d3d0-4b8e-b868-4d4090f779e2 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] 10.222.0.18 "GET /compute/v2.1/servers/72af7667-a283-4567-894f-2bd233c01001" status: 200 len: 1739 microversion: 2.20 time: 0.657305 Jun 24 16:38:28.722730 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 336/649] 10.222.0.18 () {60 vars in 1276 bytes} [Fri Jun 24 16:38:28 2022] GET /compute/v2.1/servers/72af7667-a283-4567-894f-2bd233c01001 => generated 1739 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 16:38:28.732756 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-66b5f017-0263-473f-be74-014c267864f2 tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Calling method '>' {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:38:28.733454 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-66b5f017-0263-473f-be74-014c267864f2 tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] [instance: acca3424-5f32-44c3-8c4c-fae78593ac50] Fetching instance by UUID {{(pid=102149) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:38:28.755228 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-66b5f017-0263-473f-be74-014c267864f2 tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:38:28.755684 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-66b5f017-0263-473f-be74-014c267864f2 tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:38:28.756503 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-66b5f017-0263-473f-be74-014c267864f2 tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:38:28.761458 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-66b5f017-0263-473f-be74-014c267864f2 tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:38:29.179733 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-66b5f017-0263-473f-be74-014c267864f2 tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65d11cab328748d5a8f5e55eb439e334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901fbc33d59d49f8afa7f06d62e19e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:38:29.190934 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-66b5f017-0263-473f-be74-014c267864f2 tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] 10.222.0.18 "GET /compute/v2.1/servers/acca3424-5f32-44c3-8c4c-fae78593ac50" status: 200 len: 1452 microversion: 2.1 time: 0.471829 Jun 24 16:38:29.191872 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 314/650] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:38:28 2022] GET /compute/v2.1/servers/acca3424-5f32-44c3-8c4c-fae78593ac50 => generated 1452 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 16:38:29.741101 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-52061748-ff00-4b5b-a08f-2fb1f8fadcb2 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Calling method '>' {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:38:29.745723 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-52061748-ff00-4b5b-a08f-2fb1f8fadcb2 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] [instance: 72af7667-a283-4567-894f-2bd233c01001] Fetching instance by UUID {{(pid=102148) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:38:29.775707 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-52061748-ff00-4b5b-a08f-2fb1f8fadcb2 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:38:29.781010 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-52061748-ff00-4b5b-a08f-2fb1f8fadcb2 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:38:29.782899 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-52061748-ff00-4b5b-a08f-2fb1f8fadcb2 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:38:29.784449 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-52061748-ff00-4b5b-a08f-2fb1f8fadcb2 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:38:30.436615 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-52061748-ff00-4b5b-a08f-2fb1f8fadcb2 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7489b29cb3ef47d78dfd55794f338b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065254ebe67545639644fcbc6bd9fc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:38:30.456429 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-52061748-ff00-4b5b-a08f-2fb1f8fadcb2 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7489b29cb3ef47d78dfd55794f338b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065254ebe67545639644fcbc6bd9fc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:38:30.460345 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-52061748-ff00-4b5b-a08f-2fb1f8fadcb2 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7489b29cb3ef47d78dfd55794f338b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065254ebe67545639644fcbc6bd9fc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:38:30.466287 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-52061748-ff00-4b5b-a08f-2fb1f8fadcb2 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] 10.222.0.18 "GET /compute/v2.1/servers/72af7667-a283-4567-894f-2bd233c01001" status: 200 len: 1739 microversion: 2.20 time: 0.734008 Jun 24 16:38:30.483190 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 337/651] 10.222.0.18 () {60 vars in 1276 bytes} [Fri Jun 24 16:38:29 2022] GET /compute/v2.1/servers/72af7667-a283-4567-894f-2bd233c01001 => generated 1739 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 16:38:31.505011 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-803b3948-9993-42ac-a1a4-1c47b46e1115 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Calling method '>' {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:38:31.507012 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-803b3948-9993-42ac-a1a4-1c47b46e1115 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] [instance: 72af7667-a283-4567-894f-2bd233c01001] Fetching instance by UUID {{(pid=102149) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:38:31.519109 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-803b3948-9993-42ac-a1a4-1c47b46e1115 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:38:31.520166 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-803b3948-9993-42ac-a1a4-1c47b46e1115 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:38:31.521513 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-803b3948-9993-42ac-a1a4-1c47b46e1115 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:38:31.522128 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-803b3948-9993-42ac-a1a4-1c47b46e1115 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:38:32.390830 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-803b3948-9993-42ac-a1a4-1c47b46e1115 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7489b29cb3ef47d78dfd55794f338b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065254ebe67545639644fcbc6bd9fc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:38:32.418219 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-803b3948-9993-42ac-a1a4-1c47b46e1115 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7489b29cb3ef47d78dfd55794f338b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065254ebe67545639644fcbc6bd9fc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:38:32.422223 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-803b3948-9993-42ac-a1a4-1c47b46e1115 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7489b29cb3ef47d78dfd55794f338b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065254ebe67545639644fcbc6bd9fc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:38:32.433184 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-803b3948-9993-42ac-a1a4-1c47b46e1115 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] 10.222.0.18 "GET /compute/v2.1/servers/72af7667-a283-4567-894f-2bd233c01001" status: 200 len: 1721 microversion: 2.20 time: 0.925785 Jun 24 16:38:32.448526 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 315/652] 10.222.0.18 () {60 vars in 1276 bytes} [Fri Jun 24 16:38:31 2022] GET /compute/v2.1/servers/72af7667-a283-4567-894f-2bd233c01001 => generated 1721 bytes in 940 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 16:38:33.461553 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-4f1b1b87-0573-4679-9ae3-f0218ce70346 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Calling method '>' {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:38:33.463026 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-4f1b1b87-0573-4679-9ae3-f0218ce70346 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] [instance: 72af7667-a283-4567-894f-2bd233c01001] Fetching instance by UUID {{(pid=102148) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:38:33.471986 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-4f1b1b87-0573-4679-9ae3-f0218ce70346 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:38:33.472898 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-4f1b1b87-0573-4679-9ae3-f0218ce70346 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:38:33.473941 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-4f1b1b87-0573-4679-9ae3-f0218ce70346 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:38:33.474604 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-4f1b1b87-0573-4679-9ae3-f0218ce70346 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:38:33.927123 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [req-a8c3ccdf-2766-4e14-a626-69fc3e2f66df req-40e796ec-6e84-4d41-9a3a-dbebf8edee1f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "72af7667-a283-4567-894f-2bd233c01001", "name": "network-vif-unplugged", "status": "completed", "tag": "87b332d5-d83a-40ca-bb6b-503444dbbfbe"}]} {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 16:38:33.933490 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 24 16:38:33.933490 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: warnings.warn(msg) Jun 24 16:38:33.952864 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [req-a8c3ccdf-2766-4e14-a626-69fc3e2f66df req-40e796ec-6e84-4d41-9a3a-dbebf8edee1f service nova] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:38:33.953713 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [req-a8c3ccdf-2766-4e14-a626-69fc3e2f66df req-40e796ec-6e84-4d41-9a3a-dbebf8edee1f service nova] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:38:33.989651 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.compute.server_external_events [req-a8c3ccdf-2766-4e14-a626-69fc3e2f66df req-40e796ec-6e84-4d41-9a3a-dbebf8edee1f service nova] Creating event network-vif-unplugged:87b332d5-d83a-40ca-bb6b-503444dbbfbe for instance 72af7667-a283-4567-894f-2bd233c01001 on hv-cinder-84718 Jun 24 16:38:34.000176 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [req-a8c3ccdf-2766-4e14-a626-69fc3e2f66df req-40e796ec-6e84-4d41-9a3a-dbebf8edee1f service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.082091 Jun 24 16:38:34.003090 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 316/653] 10.222.0.18 () {64 vars in 1317 bytes} [Fri Jun 24 16:38:33 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 16:38:34.160318 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-4f1b1b87-0573-4679-9ae3-f0218ce70346 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7489b29cb3ef47d78dfd55794f338b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065254ebe67545639644fcbc6bd9fc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:38:34.172622 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-4f1b1b87-0573-4679-9ae3-f0218ce70346 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7489b29cb3ef47d78dfd55794f338b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065254ebe67545639644fcbc6bd9fc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:38:34.174892 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-4f1b1b87-0573-4679-9ae3-f0218ce70346 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7489b29cb3ef47d78dfd55794f338b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065254ebe67545639644fcbc6bd9fc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:38:34.176414 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-4f1b1b87-0573-4679-9ae3-f0218ce70346 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] 10.222.0.18 "GET /compute/v2.1/servers/72af7667-a283-4567-894f-2bd233c01001" status: 200 len: 1721 microversion: 2.20 time: 0.719071 Jun 24 16:38:34.177632 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 338/654] 10.222.0.18 () {60 vars in 1276 bytes} [Fri Jun 24 16:38:33 2022] GET /compute/v2.1/servers/72af7667-a283-4567-894f-2bd233c01001 => generated 1721 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 16:38:34.341518 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [req-65502a56-9e8a-46a5-8def-7de3851db653 req-58733394-c295-4d29-a28d-37c6fd57f293 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "acca3424-5f32-44c3-8c4c-fae78593ac50", "tag": "50d5fc77-615e-4930-a0d1-7ba5a8aede09"}]} {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 16:38:34.346721 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 24 16:38:34.346721 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: warnings.warn(msg) Jun 24 16:38:34.366927 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [req-65502a56-9e8a-46a5-8def-7de3851db653 req-58733394-c295-4d29-a28d-37c6fd57f293 service nova] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:38:34.367587 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [req-65502a56-9e8a-46a5-8def-7de3851db653 req-58733394-c295-4d29-a28d-37c6fd57f293 service nova] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:38:34.433589 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.compute.server_external_events [req-65502a56-9e8a-46a5-8def-7de3851db653 req-58733394-c295-4d29-a28d-37c6fd57f293 service nova] Creating event network-changed:50d5fc77-615e-4930-a0d1-7ba5a8aede09 for instance acca3424-5f32-44c3-8c4c-fae78593ac50 on hv-cinder-84718 Jun 24 16:38:34.445117 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [req-65502a56-9e8a-46a5-8def-7de3851db653 req-58733394-c295-4d29-a28d-37c6fd57f293 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.113415 Jun 24 16:38:34.448378 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 317/655] 10.222.0.18 () {64 vars in 1317 bytes} [Fri Jun 24 16:38:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 16:38:35.000685 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-70fdb3cf-98db-47e3-987b-2a09c203ff33 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Calling method '>' {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:38:35.001272 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-70fdb3cf-98db-47e3-987b-2a09c203ff33 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] [instance: 1c66f8ad-8bbd-4134-9f8c-7fdb0be9dc48] Fetching instance by UUID {{(pid=102148) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:38:35.016422 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-70fdb3cf-98db-47e3-987b-2a09c203ff33 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:38:35.016887 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-70fdb3cf-98db-47e3-987b-2a09c203ff33 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:38:35.017642 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-70fdb3cf-98db-47e3-987b-2a09c203ff33 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:38:35.018672 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-70fdb3cf-98db-47e3-987b-2a09c203ff33 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:38:35.117467 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-70fdb3cf-98db-47e3-987b-2a09c203ff33 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] 10.222.0.18 "GET /compute/v2.1/servers/1c66f8ad-8bbd-4134-9f8c-7fdb0be9dc48/ips" status: 200 len: 151 microversion: 2.1 time: 0.120364 Jun 24 16:38:35.125874 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 339/656] 10.222.0.18 () {58 vars in 1247 bytes} [Fri Jun 24 16:38:34 2022] GET /compute/v2.1/servers/1c66f8ad-8bbd-4134-9f8c-7fdb0be9dc48/ips => generated 151 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 16:38:35.204934 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-ed71b7c4-922d-4bcf-9c3d-de509231d5b0 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Calling method '>' {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:38:35.208724 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-ed71b7c4-922d-4bcf-9c3d-de509231d5b0 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] [instance: 72af7667-a283-4567-894f-2bd233c01001] Fetching instance by UUID {{(pid=102149) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:38:35.225145 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-ed71b7c4-922d-4bcf-9c3d-de509231d5b0 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:38:35.226263 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-ed71b7c4-922d-4bcf-9c3d-de509231d5b0 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:38:35.228748 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-ed71b7c4-922d-4bcf-9c3d-de509231d5b0 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:38:35.229848 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-ed71b7c4-922d-4bcf-9c3d-de509231d5b0 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:38:35.824973 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-ed71b7c4-922d-4bcf-9c3d-de509231d5b0 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7489b29cb3ef47d78dfd55794f338b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065254ebe67545639644fcbc6bd9fc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:38:35.847687 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-ed71b7c4-922d-4bcf-9c3d-de509231d5b0 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7489b29cb3ef47d78dfd55794f338b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065254ebe67545639644fcbc6bd9fc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:38:35.849348 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-ed71b7c4-922d-4bcf-9c3d-de509231d5b0 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7489b29cb3ef47d78dfd55794f338b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065254ebe67545639644fcbc6bd9fc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:38:35.850548 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-ed71b7c4-922d-4bcf-9c3d-de509231d5b0 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] 10.222.0.18 "GET /compute/v2.1/servers/72af7667-a283-4567-894f-2bd233c01001" status: 200 len: 1664 microversion: 2.20 time: 0.656297 Jun 24 16:38:35.858171 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 318/657] 10.222.0.18 () {60 vars in 1276 bytes} [Fri Jun 24 16:38:35 2022] GET /compute/v2.1/servers/72af7667-a283-4567-894f-2bd233c01001 => generated 1664 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 16:38:35.879499 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-b202be7d-5506-4dbc-82ee-52dffbcd586c tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a42be1b3-e3e4-49c4-976d-d9233635e451"}} {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 16:38:35.881319 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-b202be7d-5506-4dbc-82ee-52dffbcd586c tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] [instance: 72af7667-a283-4567-894f-2bd233c01001] Fetching instance by UUID {{(pid=102148) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:38:35.910277 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-b202be7d-5506-4dbc-82ee-52dffbcd586c tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:38:35.911993 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-b202be7d-5506-4dbc-82ee-52dffbcd586c tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:38:35.913340 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-b202be7d-5506-4dbc-82ee-52dffbcd586c tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:38:35.913965 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-b202be7d-5506-4dbc-82ee-52dffbcd586c tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:38:36.586149 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-b202be7d-5506-4dbc-82ee-52dffbcd586c tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] 10.222.0.18 "POST /compute/v2.1/servers/72af7667-a283-4567-894f-2bd233c01001/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.711585 Jun 24 16:38:36.594336 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 340/658] 10.222.0.18 () {62 vars in 1363 bytes} [Fri Jun 24 16:38:35 2022] POST /compute/v2.1/servers/72af7667-a283-4567-894f-2bd233c01001/os-volume_attachments => generated 188 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 16:38:36.841159 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-001244af-6f41-4c60-8f84-acf14e5c84f4 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Calling method '>' {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:38:36.841726 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-001244af-6f41-4c60-8f84-acf14e5c84f4 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] [instance: 72af7667-a283-4567-894f-2bd233c01001] Fetching instance by UUID {{(pid=102149) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:38:36.851823 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-001244af-6f41-4c60-8f84-acf14e5c84f4 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:38:36.852603 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-001244af-6f41-4c60-8f84-acf14e5c84f4 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:38:36.853484 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-001244af-6f41-4c60-8f84-acf14e5c84f4 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:38:36.853925 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-001244af-6f41-4c60-8f84-acf14e5c84f4 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:38:37.045493 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-e6ceb57c-60b3-4cc0-a42c-62415142ccba tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7be9aeaf-ff9a-4091-aed3-eda01a49b46b"}} {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 16:38:37.046644 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-e6ceb57c-60b3-4cc0-a42c-62415142ccba tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] [instance: 1c66f8ad-8bbd-4134-9f8c-7fdb0be9dc48] Fetching instance by UUID {{(pid=102148) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:38:37.056502 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-e6ceb57c-60b3-4cc0-a42c-62415142ccba tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:38:37.057250 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-e6ceb57c-60b3-4cc0-a42c-62415142ccba tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:38:37.058195 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-e6ceb57c-60b3-4cc0-a42c-62415142ccba tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:38:37.058823 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-e6ceb57c-60b3-4cc0-a42c-62415142ccba tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:38:37.564256 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-001244af-6f41-4c60-8f84-acf14e5c84f4 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] 10.222.0.18 "DELETE /compute/v2.1/servers/72af7667-a283-4567-894f-2bd233c01001/os-volume_attachments/a42be1b3-e3e4-49c4-976d-d9233635e451" status: 202 len: 0 microversion: 2.20 time: 0.725598 Jun 24 16:38:37.571728 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 319/659] 10.222.0.18 () {60 vars in 1456 bytes} [Fri Jun 24 16:38:36 2022] DELETE /compute/v2.1/servers/72af7667-a283-4567-894f-2bd233c01001/os-volume_attachments/a42be1b3-e3e4-49c4-976d-d9233635e451 => generated 0 bytes in 733 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 24 16:38:37.736256 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-f037d4af-721c-4afa-a815-c729b018314c tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 16:38:37.737707 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-f037d4af-721c-4afa-a815-c729b018314c tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] [instance: 72af7667-a283-4567-894f-2bd233c01001] Fetching instance by UUID {{(pid=102149) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:38:37.753842 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-f037d4af-721c-4afa-a815-c729b018314c tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:38:37.754625 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-f037d4af-721c-4afa-a815-c729b018314c tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:38:37.755812 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-f037d4af-721c-4afa-a815-c729b018314c tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:38:37.756408 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-f037d4af-721c-4afa-a815-c729b018314c tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:38:37.760428 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-e6ceb57c-60b3-4cc0-a42c-62415142ccba tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] 10.222.0.18 "POST /compute/v2.1/servers/1c66f8ad-8bbd-4134-9f8c-7fdb0be9dc48/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.718490 Jun 24 16:38:37.761323 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 341/660] 10.222.0.18 () {60 vars in 1322 bytes} [Fri Jun 24 16:38:37 2022] POST /compute/v2.1/servers/1c66f8ad-8bbd-4134-9f8c-7fdb0be9dc48/os-volume_attachments => generated 194 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 16:38:38.068597 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-f037d4af-721c-4afa-a815-c729b018314c tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] 10.222.0.18 "POST /compute/v2.1/servers/72af7667-a283-4567-894f-2bd233c01001/action" status: 202 len: 0 microversion: 2.20 time: 0.334169 Jun 24 16:38:38.076308 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 320/661] 10.222.0.18 () {62 vars in 1318 bytes} [Fri Jun 24 16:38:37 2022] POST /compute/v2.1/servers/72af7667-a283-4567-894f-2bd233c01001/action => generated 0 bytes in 345 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jun 24 16:38:38.083809 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-e71e4294-ec9e-436e-b900-ea382bd0c462 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Calling method '>' {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:38:38.084542 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-e71e4294-ec9e-436e-b900-ea382bd0c462 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] [instance: 72af7667-a283-4567-894f-2bd233c01001] Fetching instance by UUID {{(pid=102148) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:38:38.103715 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-e71e4294-ec9e-436e-b900-ea382bd0c462 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:38:38.104559 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-e71e4294-ec9e-436e-b900-ea382bd0c462 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:38:38.106188 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-e71e4294-ec9e-436e-b900-ea382bd0c462 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:38:38.109977 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-e71e4294-ec9e-436e-b900-ea382bd0c462 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:38:38.516455 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-e71e4294-ec9e-436e-b900-ea382bd0c462 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7489b29cb3ef47d78dfd55794f338b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065254ebe67545639644fcbc6bd9fc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:38:38.530840 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-e71e4294-ec9e-436e-b900-ea382bd0c462 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7489b29cb3ef47d78dfd55794f338b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065254ebe67545639644fcbc6bd9fc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:38:38.535707 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-e71e4294-ec9e-436e-b900-ea382bd0c462 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7489b29cb3ef47d78dfd55794f338b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065254ebe67545639644fcbc6bd9fc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:38:38.538038 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-e71e4294-ec9e-436e-b900-ea382bd0c462 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] 10.222.0.18 "GET /compute/v2.1/servers/72af7667-a283-4567-894f-2bd233c01001" status: 200 len: 1672 microversion: 2.20 time: 0.460973 Jun 24 16:38:38.539308 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 342/662] 10.222.0.18 () {60 vars in 1276 bytes} [Fri Jun 24 16:38:38 2022] GET /compute/v2.1/servers/72af7667-a283-4567-894f-2bd233c01001 => generated 1672 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 16:38:39.571507 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-fcb3fe8b-05c0-4da3-a2d1-dd9862c683ef tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Calling method '>' {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:38:39.576660 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-fcb3fe8b-05c0-4da3-a2d1-dd9862c683ef tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] [instance: 72af7667-a283-4567-894f-2bd233c01001] Fetching instance by UUID {{(pid=102149) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:38:39.594843 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-fcb3fe8b-05c0-4da3-a2d1-dd9862c683ef tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:38:39.597354 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-fcb3fe8b-05c0-4da3-a2d1-dd9862c683ef tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:38:39.599316 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-fcb3fe8b-05c0-4da3-a2d1-dd9862c683ef tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:38:39.600374 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-fcb3fe8b-05c0-4da3-a2d1-dd9862c683ef tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:38:40.270059 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-fcb3fe8b-05c0-4da3-a2d1-dd9862c683ef tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7489b29cb3ef47d78dfd55794f338b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065254ebe67545639644fcbc6bd9fc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:38:40.284039 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-fcb3fe8b-05c0-4da3-a2d1-dd9862c683ef tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7489b29cb3ef47d78dfd55794f338b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065254ebe67545639644fcbc6bd9fc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:38:40.290195 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-fcb3fe8b-05c0-4da3-a2d1-dd9862c683ef tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7489b29cb3ef47d78dfd55794f338b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065254ebe67545639644fcbc6bd9fc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:38:40.291424 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-fcb3fe8b-05c0-4da3-a2d1-dd9862c683ef tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] 10.222.0.18 "GET /compute/v2.1/servers/72af7667-a283-4567-894f-2bd233c01001" status: 200 len: 1672 microversion: 2.20 time: 0.728522 Jun 24 16:38:40.292316 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 321/663] 10.222.0.18 () {60 vars in 1276 bytes} [Fri Jun 24 16:38:39 2022] GET /compute/v2.1/servers/72af7667-a283-4567-894f-2bd233c01001 => generated 1672 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 16:38:41.313860 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-f9366a95-2931-45b7-ae70-da57ed4731c2 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Calling method '>' {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:38:41.315304 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-f9366a95-2931-45b7-ae70-da57ed4731c2 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] [instance: 72af7667-a283-4567-894f-2bd233c01001] Fetching instance by UUID {{(pid=102148) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:38:41.325518 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-f9366a95-2931-45b7-ae70-da57ed4731c2 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:38:41.326851 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-f9366a95-2931-45b7-ae70-da57ed4731c2 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:38:41.328650 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-f9366a95-2931-45b7-ae70-da57ed4731c2 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:38:41.329951 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-f9366a95-2931-45b7-ae70-da57ed4731c2 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:38:42.174487 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-f9366a95-2931-45b7-ae70-da57ed4731c2 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7489b29cb3ef47d78dfd55794f338b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065254ebe67545639644fcbc6bd9fc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:38:42.190075 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-f9366a95-2931-45b7-ae70-da57ed4731c2 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7489b29cb3ef47d78dfd55794f338b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065254ebe67545639644fcbc6bd9fc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:38:42.192303 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-f9366a95-2931-45b7-ae70-da57ed4731c2 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7489b29cb3ef47d78dfd55794f338b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065254ebe67545639644fcbc6bd9fc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:38:42.193797 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-f9366a95-2931-45b7-ae70-da57ed4731c2 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] 10.222.0.18 "GET /compute/v2.1/servers/72af7667-a283-4567-894f-2bd233c01001" status: 200 len: 1730 microversion: 2.20 time: 0.884059 Jun 24 16:38:42.207567 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 343/664] 10.222.0.18 () {60 vars in 1276 bytes} [Fri Jun 24 16:38:41 2022] GET /compute/v2.1/servers/72af7667-a283-4567-894f-2bd233c01001 => generated 1730 bytes in 898 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 16:38:43.219263 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-dedb88c7-3e67-4c70-bf57-e601ec6db0c1 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Calling method '>' {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:38:43.220101 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-dedb88c7-3e67-4c70-bf57-e601ec6db0c1 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] [instance: 72af7667-a283-4567-894f-2bd233c01001] Fetching instance by UUID {{(pid=102149) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:38:43.228453 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-dedb88c7-3e67-4c70-bf57-e601ec6db0c1 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:38:43.229177 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-dedb88c7-3e67-4c70-bf57-e601ec6db0c1 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:38:43.230820 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-dedb88c7-3e67-4c70-bf57-e601ec6db0c1 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:38:43.231476 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-dedb88c7-3e67-4c70-bf57-e601ec6db0c1 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:38:43.598908 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-dedb88c7-3e67-4c70-bf57-e601ec6db0c1 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7489b29cb3ef47d78dfd55794f338b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065254ebe67545639644fcbc6bd9fc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:38:43.616074 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-dedb88c7-3e67-4c70-bf57-e601ec6db0c1 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7489b29cb3ef47d78dfd55794f338b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065254ebe67545639644fcbc6bd9fc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:38:43.620060 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-dedb88c7-3e67-4c70-bf57-e601ec6db0c1 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7489b29cb3ef47d78dfd55794f338b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065254ebe67545639644fcbc6bd9fc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:38:43.623055 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-dedb88c7-3e67-4c70-bf57-e601ec6db0c1 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] 10.222.0.18 "GET /compute/v2.1/servers/72af7667-a283-4567-894f-2bd233c01001" status: 200 len: 1730 microversion: 2.20 time: 0.409405 Jun 24 16:38:43.624950 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 322/665] 10.222.0.18 () {60 vars in 1276 bytes} [Fri Jun 24 16:38:43 2022] GET /compute/v2.1/servers/72af7667-a283-4567-894f-2bd233c01001 => generated 1730 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 16:38:44.643006 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-d91fcc52-4158-475b-9faa-2a8c3a8de30f tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Calling method '>' {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:38:44.645272 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-d91fcc52-4158-475b-9faa-2a8c3a8de30f tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] [instance: 72af7667-a283-4567-894f-2bd233c01001] Fetching instance by UUID {{(pid=102148) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:38:44.660004 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-d91fcc52-4158-475b-9faa-2a8c3a8de30f tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:38:44.661833 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-d91fcc52-4158-475b-9faa-2a8c3a8de30f tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:38:44.662878 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-d91fcc52-4158-475b-9faa-2a8c3a8de30f tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:38:44.666188 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-d91fcc52-4158-475b-9faa-2a8c3a8de30f tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:38:45.183521 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-d91fcc52-4158-475b-9faa-2a8c3a8de30f tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7489b29cb3ef47d78dfd55794f338b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065254ebe67545639644fcbc6bd9fc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:38:45.200098 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-d91fcc52-4158-475b-9faa-2a8c3a8de30f tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7489b29cb3ef47d78dfd55794f338b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065254ebe67545639644fcbc6bd9fc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:38:45.202095 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-d91fcc52-4158-475b-9faa-2a8c3a8de30f tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7489b29cb3ef47d78dfd55794f338b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065254ebe67545639644fcbc6bd9fc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:38:45.207004 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-d91fcc52-4158-475b-9faa-2a8c3a8de30f tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] 10.222.0.18 "GET /compute/v2.1/servers/72af7667-a283-4567-894f-2bd233c01001" status: 200 len: 1730 microversion: 2.20 time: 0.568029 Jun 24 16:38:45.223462 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 344/666] 10.222.0.18 () {60 vars in 1276 bytes} [Fri Jun 24 16:38:44 2022] GET /compute/v2.1/servers/72af7667-a283-4567-894f-2bd233c01001 => generated 1730 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 16:38:46.252800 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-8c37223e-cfee-4634-8d12-ed1553ab881f tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Calling method '>' {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:38:46.255944 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-8c37223e-cfee-4634-8d12-ed1553ab881f tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] [instance: 72af7667-a283-4567-894f-2bd233c01001] Fetching instance by UUID {{(pid=102149) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:38:46.286610 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-8c37223e-cfee-4634-8d12-ed1553ab881f tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:38:46.293830 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-8c37223e-cfee-4634-8d12-ed1553ab881f tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:38:46.295620 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-8c37223e-cfee-4634-8d12-ed1553ab881f tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:38:46.296601 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-8c37223e-cfee-4634-8d12-ed1553ab881f tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:38:46.851071 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-5c10ba41-ff29-43ec-9733-1d0e44bd178e tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Calling method '>' {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:38:46.852605 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-5c10ba41-ff29-43ec-9733-1d0e44bd178e tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] [instance: 1c66f8ad-8bbd-4134-9f8c-7fdb0be9dc48] Fetching instance by UUID {{(pid=102148) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:38:46.864388 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-5c10ba41-ff29-43ec-9733-1d0e44bd178e tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:38:46.869345 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-5c10ba41-ff29-43ec-9733-1d0e44bd178e tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:38:46.871620 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-5c10ba41-ff29-43ec-9733-1d0e44bd178e tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:38:46.874905 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-5c10ba41-ff29-43ec-9733-1d0e44bd178e tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:38:47.022373 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-8c37223e-cfee-4634-8d12-ed1553ab881f tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7489b29cb3ef47d78dfd55794f338b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065254ebe67545639644fcbc6bd9fc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:38:47.039422 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-8c37223e-cfee-4634-8d12-ed1553ab881f tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7489b29cb3ef47d78dfd55794f338b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065254ebe67545639644fcbc6bd9fc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:38:47.041269 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-8c37223e-cfee-4634-8d12-ed1553ab881f tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7489b29cb3ef47d78dfd55794f338b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065254ebe67545639644fcbc6bd9fc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:38:47.042815 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-8c37223e-cfee-4634-8d12-ed1553ab881f tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] 10.222.0.18 "GET /compute/v2.1/servers/72af7667-a283-4567-894f-2bd233c01001" status: 200 len: 1730 microversion: 2.20 time: 0.798153 Jun 24 16:38:47.060691 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 323/667] 10.222.0.18 () {60 vars in 1276 bytes} [Fri Jun 24 16:38:46 2022] GET /compute/v2.1/servers/72af7667-a283-4567-894f-2bd233c01001 => generated 1730 bytes in 817 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 16:38:47.135361 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.objects.instance [None req-5c10ba41-ff29-43ec-9733-1d0e44bd178e tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lazy-loading 'services' on Instance uuid 1c66f8ad-8bbd-4134-9f8c-7fdb0be9dc48 {{(pid=102148) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Jun 24 16:38:47.357583 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-5c10ba41-ff29-43ec-9733-1d0e44bd178e tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] 10.222.0.18 "DELETE /compute/v2.1/servers/1c66f8ad-8bbd-4134-9f8c-7fdb0be9dc48/os-volume_attachments/7be9aeaf-ff9a-4091-aed3-eda01a49b46b" status: 202 len: 0 microversion: 2.1 time: 0.510123 Jun 24 16:38:47.363175 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 345/668] 10.222.0.18 () {58 vars in 1415 bytes} [Fri Jun 24 16:38:46 2022] DELETE /compute/v2.1/servers/1c66f8ad-8bbd-4134-9f8c-7fdb0be9dc48/os-volume_attachments/7be9aeaf-ff9a-4091-aed3-eda01a49b46b => generated 0 bytes in 512 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 24 16:38:47.369423 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-2e07a0ba-2591-46c1-a88b-da48ae517b87 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Calling method '>' {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:38:47.370061 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-2e07a0ba-2591-46c1-a88b-da48ae517b87 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] [instance: 1c66f8ad-8bbd-4134-9f8c-7fdb0be9dc48] Fetching instance by UUID {{(pid=102149) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:38:47.387948 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-2e07a0ba-2591-46c1-a88b-da48ae517b87 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:38:47.388650 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-2e07a0ba-2591-46c1-a88b-da48ae517b87 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:38:47.389600 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-2e07a0ba-2591-46c1-a88b-da48ae517b87 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:38:47.390181 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-2e07a0ba-2591-46c1-a88b-da48ae517b87 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:38:47.576680 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-2e07a0ba-2591-46c1-a88b-da48ae517b87 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] 10.222.0.18 "GET /compute/v2.1/servers/1c66f8ad-8bbd-4134-9f8c-7fdb0be9dc48/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.212008 Jun 24 16:38:47.577631 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 324/669] 10.222.0.18 () {58 vars in 1301 bytes} [Fri Jun 24 16:38:47 2022] GET /compute/v2.1/servers/1c66f8ad-8bbd-4134-9f8c-7fdb0be9dc48/os-volume_attachments => generated 197 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 16:38:48.073148 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-04dd66b2-e82e-4642-804a-9a2a7ff9e683 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Calling method '>' {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:38:48.074294 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-04dd66b2-e82e-4642-804a-9a2a7ff9e683 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] [instance: 72af7667-a283-4567-894f-2bd233c01001] Fetching instance by UUID {{(pid=102148) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:38:48.095549 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-04dd66b2-e82e-4642-804a-9a2a7ff9e683 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:38:48.096276 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-04dd66b2-e82e-4642-804a-9a2a7ff9e683 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:38:48.098529 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-04dd66b2-e82e-4642-804a-9a2a7ff9e683 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:38:48.100292 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-04dd66b2-e82e-4642-804a-9a2a7ff9e683 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:38:48.597379 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-b6537d8b-452a-46b8-a0ae-c8f38859bf75 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Calling method '>' {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:38:48.600396 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-b6537d8b-452a-46b8-a0ae-c8f38859bf75 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] [instance: 1c66f8ad-8bbd-4134-9f8c-7fdb0be9dc48] Fetching instance by UUID {{(pid=102149) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:38:48.621930 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-b6537d8b-452a-46b8-a0ae-c8f38859bf75 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:38:48.623340 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-b6537d8b-452a-46b8-a0ae-c8f38859bf75 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:38:48.624405 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-b6537d8b-452a-46b8-a0ae-c8f38859bf75 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:38:48.625516 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-b6537d8b-452a-46b8-a0ae-c8f38859bf75 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:38:48.707664 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-b6537d8b-452a-46b8-a0ae-c8f38859bf75 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] 10.222.0.18 "GET /compute/v2.1/servers/1c66f8ad-8bbd-4134-9f8c-7fdb0be9dc48/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.119116 Jun 24 16:38:48.711957 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 325/670] 10.222.0.18 () {58 vars in 1301 bytes} [Fri Jun 24 16:38:48 2022] GET /compute/v2.1/servers/1c66f8ad-8bbd-4134-9f8c-7fdb0be9dc48/os-volume_attachments => generated 197 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 16:38:48.753339 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-04dd66b2-e82e-4642-804a-9a2a7ff9e683 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7489b29cb3ef47d78dfd55794f338b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065254ebe67545639644fcbc6bd9fc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:38:48.764623 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-04dd66b2-e82e-4642-804a-9a2a7ff9e683 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7489b29cb3ef47d78dfd55794f338b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065254ebe67545639644fcbc6bd9fc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:38:48.766791 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-04dd66b2-e82e-4642-804a-9a2a7ff9e683 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7489b29cb3ef47d78dfd55794f338b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065254ebe67545639644fcbc6bd9fc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:38:48.768961 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-04dd66b2-e82e-4642-804a-9a2a7ff9e683 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] 10.222.0.18 "GET /compute/v2.1/servers/72af7667-a283-4567-894f-2bd233c01001" status: 200 len: 1730 microversion: 2.20 time: 0.702649 Jun 24 16:38:48.770910 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 346/671] 10.222.0.18 () {60 vars in 1276 bytes} [Fri Jun 24 16:38:48 2022] GET /compute/v2.1/servers/72af7667-a283-4567-894f-2bd233c01001 => generated 1730 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 16:38:49.720666 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-bdeb3e27-9695-4200-be37-8504dbe77fad tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Calling method '>' {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:38:49.722302 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-bdeb3e27-9695-4200-be37-8504dbe77fad tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] [instance: 1c66f8ad-8bbd-4134-9f8c-7fdb0be9dc48] Fetching instance by UUID {{(pid=102149) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:38:49.738500 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-bdeb3e27-9695-4200-be37-8504dbe77fad tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:38:49.739282 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-bdeb3e27-9695-4200-be37-8504dbe77fad tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:38:49.740267 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-bdeb3e27-9695-4200-be37-8504dbe77fad tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:38:49.740861 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-bdeb3e27-9695-4200-be37-8504dbe77fad tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:38:49.792147 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-203cbc0d-f2e0-48e1-b578-13eb475c473f tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Calling method '>' {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:38:49.793365 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-203cbc0d-f2e0-48e1-b578-13eb475c473f tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] [instance: 72af7667-a283-4567-894f-2bd233c01001] Fetching instance by UUID {{(pid=102148) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:38:49.809554 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-203cbc0d-f2e0-48e1-b578-13eb475c473f tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:38:49.811588 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-203cbc0d-f2e0-48e1-b578-13eb475c473f tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:38:49.812433 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-203cbc0d-f2e0-48e1-b578-13eb475c473f tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:38:49.812868 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-203cbc0d-f2e0-48e1-b578-13eb475c473f tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:38:49.880384 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-bdeb3e27-9695-4200-be37-8504dbe77fad tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] 10.222.0.18 "GET /compute/v2.1/servers/1c66f8ad-8bbd-4134-9f8c-7fdb0be9dc48/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.164803 Jun 24 16:38:49.888413 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 326/672] 10.222.0.18 () {58 vars in 1301 bytes} [Fri Jun 24 16:38:49 2022] GET /compute/v2.1/servers/1c66f8ad-8bbd-4134-9f8c-7fdb0be9dc48/os-volume_attachments => generated 197 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 16:38:50.438334 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-203cbc0d-f2e0-48e1-b578-13eb475c473f tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7489b29cb3ef47d78dfd55794f338b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065254ebe67545639644fcbc6bd9fc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:38:50.484837 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-203cbc0d-f2e0-48e1-b578-13eb475c473f tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7489b29cb3ef47d78dfd55794f338b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065254ebe67545639644fcbc6bd9fc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:38:50.491056 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-203cbc0d-f2e0-48e1-b578-13eb475c473f tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7489b29cb3ef47d78dfd55794f338b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065254ebe67545639644fcbc6bd9fc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:38:50.492947 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-203cbc0d-f2e0-48e1-b578-13eb475c473f tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] 10.222.0.18 "GET /compute/v2.1/servers/72af7667-a283-4567-894f-2bd233c01001" status: 200 len: 1730 microversion: 2.20 time: 0.704577 Jun 24 16:38:50.496489 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 347/673] 10.222.0.18 () {60 vars in 1276 bytes} [Fri Jun 24 16:38:49 2022] GET /compute/v2.1/servers/72af7667-a283-4567-894f-2bd233c01001 => generated 1730 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 16:38:50.894183 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-bc025edc-4bb1-4c31-aa4b-44ccc34d1fa9 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Calling method '>' {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:38:50.896319 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-bc025edc-4bb1-4c31-aa4b-44ccc34d1fa9 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] [instance: 1c66f8ad-8bbd-4134-9f8c-7fdb0be9dc48] Fetching instance by UUID {{(pid=102149) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:38:50.926116 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-bc025edc-4bb1-4c31-aa4b-44ccc34d1fa9 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:38:50.927934 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-bc025edc-4bb1-4c31-aa4b-44ccc34d1fa9 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:38:50.931330 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-bc025edc-4bb1-4c31-aa4b-44ccc34d1fa9 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:38:50.931943 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-bc025edc-4bb1-4c31-aa4b-44ccc34d1fa9 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:38:51.206538 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-bc025edc-4bb1-4c31-aa4b-44ccc34d1fa9 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] 10.222.0.18 "GET /compute/v2.1/servers/1c66f8ad-8bbd-4134-9f8c-7fdb0be9dc48/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.316928 Jun 24 16:38:51.209959 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 327/674] 10.222.0.18 () {58 vars in 1301 bytes} [Fri Jun 24 16:38:50 2022] GET /compute/v2.1/servers/1c66f8ad-8bbd-4134-9f8c-7fdb0be9dc48/os-volume_attachments => generated 197 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 16:38:51.516849 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-a6458b96-4e1f-4620-a777-d9c6c420d291 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Calling method '>' {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:38:51.517526 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-a6458b96-4e1f-4620-a777-d9c6c420d291 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] [instance: 72af7667-a283-4567-894f-2bd233c01001] Fetching instance by UUID {{(pid=102148) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:38:51.536902 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-a6458b96-4e1f-4620-a777-d9c6c420d291 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:38:51.537364 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-a6458b96-4e1f-4620-a777-d9c6c420d291 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:38:51.538164 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-a6458b96-4e1f-4620-a777-d9c6c420d291 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:38:51.544246 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-a6458b96-4e1f-4620-a777-d9c6c420d291 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:38:52.007291 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-a6458b96-4e1f-4620-a777-d9c6c420d291 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7489b29cb3ef47d78dfd55794f338b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065254ebe67545639644fcbc6bd9fc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:38:52.017209 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-a6458b96-4e1f-4620-a777-d9c6c420d291 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7489b29cb3ef47d78dfd55794f338b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065254ebe67545639644fcbc6bd9fc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:38:52.020003 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-a6458b96-4e1f-4620-a777-d9c6c420d291 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7489b29cb3ef47d78dfd55794f338b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065254ebe67545639644fcbc6bd9fc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:38:52.021308 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-a6458b96-4e1f-4620-a777-d9c6c420d291 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] 10.222.0.18 "GET /compute/v2.1/servers/72af7667-a283-4567-894f-2bd233c01001" status: 200 len: 1730 microversion: 2.20 time: 0.511139 Jun 24 16:38:52.021892 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 348/675] 10.222.0.18 () {60 vars in 1276 bytes} [Fri Jun 24 16:38:51 2022] GET /compute/v2.1/servers/72af7667-a283-4567-894f-2bd233c01001 => generated 1730 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 16:38:52.223594 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-48779cc6-99b0-4b24-988e-471f896fff1f tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Calling method '>' {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:38:52.230175 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-48779cc6-99b0-4b24-988e-471f896fff1f tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] [instance: 1c66f8ad-8bbd-4134-9f8c-7fdb0be9dc48] Fetching instance by UUID {{(pid=102149) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:38:52.259753 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-48779cc6-99b0-4b24-988e-471f896fff1f tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:38:52.260775 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-48779cc6-99b0-4b24-988e-471f896fff1f tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:38:52.262319 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-48779cc6-99b0-4b24-988e-471f896fff1f tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:38:52.270746 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-48779cc6-99b0-4b24-988e-471f896fff1f tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:38:52.456969 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-48779cc6-99b0-4b24-988e-471f896fff1f tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] 10.222.0.18 "GET /compute/v2.1/servers/1c66f8ad-8bbd-4134-9f8c-7fdb0be9dc48/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.241447 Jun 24 16:38:52.460482 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 328/676] 10.222.0.18 () {58 vars in 1301 bytes} [Fri Jun 24 16:38:52 2022] GET /compute/v2.1/servers/1c66f8ad-8bbd-4134-9f8c-7fdb0be9dc48/os-volume_attachments => generated 25 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 24 16:38:52.661390 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-285e6b69-1334-452e-9bbf-ce2a701a5ba8 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Calling method '>' {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:38:52.662638 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-285e6b69-1334-452e-9bbf-ce2a701a5ba8 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] [instance: 1c66f8ad-8bbd-4134-9f8c-7fdb0be9dc48] Fetching instance by UUID {{(pid=102148) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:38:52.677314 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-285e6b69-1334-452e-9bbf-ce2a701a5ba8 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:38:52.680696 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-285e6b69-1334-452e-9bbf-ce2a701a5ba8 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:38:52.682713 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-285e6b69-1334-452e-9bbf-ce2a701a5ba8 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:38:52.685610 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-285e6b69-1334-452e-9bbf-ce2a701a5ba8 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:38:52.866245 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-285e6b69-1334-452e-9bbf-ce2a701a5ba8 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] [instance: 1c66f8ad-8bbd-4134-9f8c-7fdb0be9dc48] Going to try to terminate instance {{(pid=102148) delete /opt/stack/nova/nova/compute/api.py:2562}} Jun 24 16:38:53.040202 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-57456ebf-cfef-4263-9d57-c462be1271ba tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Calling method '>' {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:38:53.040811 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-57456ebf-cfef-4263-9d57-c462be1271ba tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] [instance: 72af7667-a283-4567-894f-2bd233c01001] Fetching instance by UUID {{(pid=102149) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:38:53.054780 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-57456ebf-cfef-4263-9d57-c462be1271ba tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:38:53.055222 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-57456ebf-cfef-4263-9d57-c462be1271ba tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:38:53.063727 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-57456ebf-cfef-4263-9d57-c462be1271ba tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:38:53.064228 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-57456ebf-cfef-4263-9d57-c462be1271ba tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:38:53.178249 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-285e6b69-1334-452e-9bbf-ce2a701a5ba8 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] 10.222.0.18 "DELETE /compute/v2.1/servers/1c66f8ad-8bbd-4134-9f8c-7fdb0be9dc48" status: 204 len: 0 microversion: 2.1 time: 0.520295 Jun 24 16:38:53.184162 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 349/677] 10.222.0.18 () {58 vars in 1238 bytes} [Fri Jun 24 16:38:52 2022] DELETE /compute/v2.1/servers/1c66f8ad-8bbd-4134-9f8c-7fdb0be9dc48 => generated 0 bytes in 527 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 24 16:38:53.212265 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-d533712f-68f1-41b1-a25f-2510140adebe tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Calling method '>' {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:38:53.214067 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-d533712f-68f1-41b1-a25f-2510140adebe tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] [instance: 1c66f8ad-8bbd-4134-9f8c-7fdb0be9dc48] Fetching instance by UUID {{(pid=102148) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:38:53.275768 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-d533712f-68f1-41b1-a25f-2510140adebe tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:38:53.280262 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-d533712f-68f1-41b1-a25f-2510140adebe tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:38:53.283496 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-d533712f-68f1-41b1-a25f-2510140adebe tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:38:53.286114 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-d533712f-68f1-41b1-a25f-2510140adebe tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:38:53.631445 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-57456ebf-cfef-4263-9d57-c462be1271ba tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7489b29cb3ef47d78dfd55794f338b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065254ebe67545639644fcbc6bd9fc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:38:53.651640 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-57456ebf-cfef-4263-9d57-c462be1271ba tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7489b29cb3ef47d78dfd55794f338b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065254ebe67545639644fcbc6bd9fc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:38:53.655768 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-57456ebf-cfef-4263-9d57-c462be1271ba tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7489b29cb3ef47d78dfd55794f338b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065254ebe67545639644fcbc6bd9fc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:38:53.659569 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-57456ebf-cfef-4263-9d57-c462be1271ba tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] 10.222.0.18 "GET /compute/v2.1/servers/72af7667-a283-4567-894f-2bd233c01001" status: 200 len: 1730 microversion: 2.20 time: 0.623186 Jun 24 16:38:53.661286 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 329/678] 10.222.0.18 () {60 vars in 1276 bytes} [Fri Jun 24 16:38:53 2022] GET /compute/v2.1/servers/72af7667-a283-4567-894f-2bd233c01001 => generated 1730 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 16:38:53.891377 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-d533712f-68f1-41b1-a25f-2510140adebe tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '499faf87cf8c41ae823b2566e4c2d8ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606ba814a2d8408ab0856d539ca79b4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:38:53.900764 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-d533712f-68f1-41b1-a25f-2510140adebe tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] 10.222.0.18 "GET /compute/v2.1/servers/1c66f8ad-8bbd-4134-9f8c-7fdb0be9dc48" status: 200 len: 1683 microversion: 2.1 time: 0.711865 Jun 24 16:38:53.902526 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 350/679] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:38:53 2022] GET /compute/v2.1/servers/1c66f8ad-8bbd-4134-9f8c-7fdb0be9dc48 => generated 1683 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 16:38:54.685641 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-9817596b-3d1d-44b5-9556-f30b58ab99f1 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Calling method '>' {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:38:54.687551 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-9817596b-3d1d-44b5-9556-f30b58ab99f1 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] [instance: 72af7667-a283-4567-894f-2bd233c01001] Fetching instance by UUID {{(pid=102149) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:38:54.711928 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-9817596b-3d1d-44b5-9556-f30b58ab99f1 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:38:54.717720 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-9817596b-3d1d-44b5-9556-f30b58ab99f1 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:38:54.722852 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-9817596b-3d1d-44b5-9556-f30b58ab99f1 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:38:54.725657 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-9817596b-3d1d-44b5-9556-f30b58ab99f1 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:38:54.926155 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-ce831736-ebd9-4f88-80fe-a08541e30725 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Calling method '>' {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:38:54.927288 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-ce831736-ebd9-4f88-80fe-a08541e30725 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] [instance: 1c66f8ad-8bbd-4134-9f8c-7fdb0be9dc48] Fetching instance by UUID {{(pid=102148) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:38:54.956827 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-ce831736-ebd9-4f88-80fe-a08541e30725 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:38:54.957262 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-ce831736-ebd9-4f88-80fe-a08541e30725 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:38:54.960750 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-ce831736-ebd9-4f88-80fe-a08541e30725 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:38:54.961194 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-ce831736-ebd9-4f88-80fe-a08541e30725 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:38:55.374014 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-9817596b-3d1d-44b5-9556-f30b58ab99f1 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7489b29cb3ef47d78dfd55794f338b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065254ebe67545639644fcbc6bd9fc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:38:55.398775 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-9817596b-3d1d-44b5-9556-f30b58ab99f1 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7489b29cb3ef47d78dfd55794f338b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065254ebe67545639644fcbc6bd9fc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:38:55.400769 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-9817596b-3d1d-44b5-9556-f30b58ab99f1 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7489b29cb3ef47d78dfd55794f338b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065254ebe67545639644fcbc6bd9fc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:38:55.405584 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-9817596b-3d1d-44b5-9556-f30b58ab99f1 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] 10.222.0.18 "GET /compute/v2.1/servers/72af7667-a283-4567-894f-2bd233c01001" status: 200 len: 1730 microversion: 2.20 time: 0.726290 Jun 24 16:38:55.406405 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 330/680] 10.222.0.18 () {60 vars in 1276 bytes} [Fri Jun 24 16:38:54 2022] GET /compute/v2.1/servers/72af7667-a283-4567-894f-2bd233c01001 => generated 1730 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 16:38:55.721507 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-ce831736-ebd9-4f88-80fe-a08541e30725 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '499faf87cf8c41ae823b2566e4c2d8ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606ba814a2d8408ab0856d539ca79b4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:38:55.738136 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-ce831736-ebd9-4f88-80fe-a08541e30725 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] 10.222.0.18 "GET /compute/v2.1/servers/1c66f8ad-8bbd-4134-9f8c-7fdb0be9dc48" status: 200 len: 1683 microversion: 2.1 time: 0.821641 Jun 24 16:38:55.742763 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 351/681] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:38:54 2022] GET /compute/v2.1/servers/1c66f8ad-8bbd-4134-9f8c-7fdb0be9dc48 => generated 1683 bytes in 827 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 16:38:56.426081 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-538ff9d3-bbd4-4bf9-82d1-4d3ab622b7a6 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Calling method '>' {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:38:56.432444 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-538ff9d3-bbd4-4bf9-82d1-4d3ab622b7a6 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] [instance: 72af7667-a283-4567-894f-2bd233c01001] Fetching instance by UUID {{(pid=102149) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:38:56.462405 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-538ff9d3-bbd4-4bf9-82d1-4d3ab622b7a6 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:38:56.463630 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-538ff9d3-bbd4-4bf9-82d1-4d3ab622b7a6 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:38:56.464723 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-538ff9d3-bbd4-4bf9-82d1-4d3ab622b7a6 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:38:56.465488 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-538ff9d3-bbd4-4bf9-82d1-4d3ab622b7a6 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:38:56.770551 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-43dbc90b-a10b-45f9-9bcf-67dc7c284b17 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Calling method '>' {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:38:56.771277 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-43dbc90b-a10b-45f9-9bcf-67dc7c284b17 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] [instance: 1c66f8ad-8bbd-4134-9f8c-7fdb0be9dc48] Fetching instance by UUID {{(pid=102148) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:38:56.781435 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-43dbc90b-a10b-45f9-9bcf-67dc7c284b17 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:38:56.799121 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-43dbc90b-a10b-45f9-9bcf-67dc7c284b17 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:38:56.811009 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-43dbc90b-a10b-45f9-9bcf-67dc7c284b17 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:38:56.811458 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-43dbc90b-a10b-45f9-9bcf-67dc7c284b17 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:38:57.139569 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-538ff9d3-bbd4-4bf9-82d1-4d3ab622b7a6 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7489b29cb3ef47d78dfd55794f338b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065254ebe67545639644fcbc6bd9fc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:38:57.154040 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-538ff9d3-bbd4-4bf9-82d1-4d3ab622b7a6 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7489b29cb3ef47d78dfd55794f338b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065254ebe67545639644fcbc6bd9fc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:38:57.155899 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-538ff9d3-bbd4-4bf9-82d1-4d3ab622b7a6 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7489b29cb3ef47d78dfd55794f338b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065254ebe67545639644fcbc6bd9fc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:38:57.158665 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-538ff9d3-bbd4-4bf9-82d1-4d3ab622b7a6 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] 10.222.0.18 "GET /compute/v2.1/servers/72af7667-a283-4567-894f-2bd233c01001" status: 200 len: 1730 microversion: 2.20 time: 0.735986 Jun 24 16:38:57.159475 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 331/682] 10.222.0.18 () {60 vars in 1276 bytes} [Fri Jun 24 16:38:56 2022] GET /compute/v2.1/servers/72af7667-a283-4567-894f-2bd233c01001 => generated 1730 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 16:38:57.945248 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-43dbc90b-a10b-45f9-9bcf-67dc7c284b17 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '499faf87cf8c41ae823b2566e4c2d8ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606ba814a2d8408ab0856d539ca79b4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:38:57.962505 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-43dbc90b-a10b-45f9-9bcf-67dc7c284b17 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] 10.222.0.18 "GET /compute/v2.1/servers/1c66f8ad-8bbd-4134-9f8c-7fdb0be9dc48" status: 200 len: 1683 microversion: 2.1 time: 1.196641 Jun 24 16:38:57.979366 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 352/683] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:38:56 2022] GET /compute/v2.1/servers/1c66f8ad-8bbd-4134-9f8c-7fdb0be9dc48 => generated 1683 bytes in 1214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 16:38:58.177128 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-462775be-90eb-48ef-9a8c-a7439b4106aa tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Calling method '>' {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:38:58.178450 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-462775be-90eb-48ef-9a8c-a7439b4106aa tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] [instance: 72af7667-a283-4567-894f-2bd233c01001] Fetching instance by UUID {{(pid=102149) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:38:58.196698 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-462775be-90eb-48ef-9a8c-a7439b4106aa tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:38:58.197490 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-462775be-90eb-48ef-9a8c-a7439b4106aa tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:38:58.198485 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-462775be-90eb-48ef-9a8c-a7439b4106aa tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:38:58.199145 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-462775be-90eb-48ef-9a8c-a7439b4106aa tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:38:58.904611 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-462775be-90eb-48ef-9a8c-a7439b4106aa tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7489b29cb3ef47d78dfd55794f338b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065254ebe67545639644fcbc6bd9fc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:38:58.922450 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-462775be-90eb-48ef-9a8c-a7439b4106aa tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7489b29cb3ef47d78dfd55794f338b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065254ebe67545639644fcbc6bd9fc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:38:58.925056 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-462775be-90eb-48ef-9a8c-a7439b4106aa tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7489b29cb3ef47d78dfd55794f338b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065254ebe67545639644fcbc6bd9fc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:38:58.926626 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-462775be-90eb-48ef-9a8c-a7439b4106aa tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] 10.222.0.18 "GET /compute/v2.1/servers/72af7667-a283-4567-894f-2bd233c01001" status: 200 len: 1730 microversion: 2.20 time: 0.753258 Jun 24 16:38:58.927855 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 332/684] 10.222.0.18 () {60 vars in 1276 bytes} [Fri Jun 24 16:38:58 2022] GET /compute/v2.1/servers/72af7667-a283-4567-894f-2bd233c01001 => generated 1730 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 16:38:58.991601 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-40240675-0682-4c56-b3f0-2acdff712aef tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Calling method '>' {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:38:58.992223 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-40240675-0682-4c56-b3f0-2acdff712aef tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] [instance: 1c66f8ad-8bbd-4134-9f8c-7fdb0be9dc48] Fetching instance by UUID {{(pid=102148) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:38:59.014899 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-40240675-0682-4c56-b3f0-2acdff712aef tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:38:59.015628 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-40240675-0682-4c56-b3f0-2acdff712aef tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:38:59.016763 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-40240675-0682-4c56-b3f0-2acdff712aef tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:38:59.017439 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-40240675-0682-4c56-b3f0-2acdff712aef tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:38:59.129233 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [req-1b5b2da9-3315-4eb3-ae24-cbbefeb420ad req-bc2113ec-3624-4381-93d9-90235b527f90 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1c66f8ad-8bbd-4134-9f8c-7fdb0be9dc48", "name": "network-vif-deleted", "tag": "12a399ee-3431-4fdd-9fd8-fd3020deecf2"}]} {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 16:38:59.132671 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 24 16:38:59.132671 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: warnings.warn(msg) Jun 24 16:38:59.158576 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [req-1b5b2da9-3315-4eb3-ae24-cbbefeb420ad req-bc2113ec-3624-4381-93d9-90235b527f90 service nova] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:38:59.159719 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [req-1b5b2da9-3315-4eb3-ae24-cbbefeb420ad req-bc2113ec-3624-4381-93d9-90235b527f90 service nova] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:38:59.192546 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.compute.server_external_events [req-1b5b2da9-3315-4eb3-ae24-cbbefeb420ad req-bc2113ec-3624-4381-93d9-90235b527f90 service nova] Creating event network-vif-deleted:12a399ee-3431-4fdd-9fd8-fd3020deecf2 for instance 1c66f8ad-8bbd-4134-9f8c-7fdb0be9dc48 on hv-cinder-84718 Jun 24 16:38:59.211020 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [req-1b5b2da9-3315-4eb3-ae24-cbbefeb420ad req-bc2113ec-3624-4381-93d9-90235b527f90 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086053 Jun 24 16:38:59.212243 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 333/685] 10.222.0.18 () {64 vars in 1317 bytes} [Fri Jun 24 16:38:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 16:38:59.276533 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-40240675-0682-4c56-b3f0-2acdff712aef tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '499faf87cf8c41ae823b2566e4c2d8ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606ba814a2d8408ab0856d539ca79b4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:38:59.296243 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-40240675-0682-4c56-b3f0-2acdff712aef tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] 10.222.0.18 "GET /compute/v2.1/servers/1c66f8ad-8bbd-4134-9f8c-7fdb0be9dc48" status: 200 len: 1615 microversion: 2.1 time: 0.312656 Jun 24 16:38:59.297163 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 353/686] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:38:58 2022] GET /compute/v2.1/servers/1c66f8ad-8bbd-4134-9f8c-7fdb0be9dc48 => generated 1615 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 16:38:59.952264 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-c1beab06-4e0f-4a6a-9e4e-dce4cb57cccd tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Calling method '>' {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:38:59.952831 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-c1beab06-4e0f-4a6a-9e4e-dce4cb57cccd tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] [instance: 72af7667-a283-4567-894f-2bd233c01001] Fetching instance by UUID {{(pid=102149) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:38:59.969353 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-c1beab06-4e0f-4a6a-9e4e-dce4cb57cccd tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:38:59.969800 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-c1beab06-4e0f-4a6a-9e4e-dce4cb57cccd tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:38:59.970664 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-c1beab06-4e0f-4a6a-9e4e-dce4cb57cccd tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:38:59.971123 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-c1beab06-4e0f-4a6a-9e4e-dce4cb57cccd tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:39:00.274762 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-c1beab06-4e0f-4a6a-9e4e-dce4cb57cccd tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7489b29cb3ef47d78dfd55794f338b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065254ebe67545639644fcbc6bd9fc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:39:00.285022 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-c1beab06-4e0f-4a6a-9e4e-dce4cb57cccd tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7489b29cb3ef47d78dfd55794f338b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065254ebe67545639644fcbc6bd9fc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:39:00.287220 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-c1beab06-4e0f-4a6a-9e4e-dce4cb57cccd tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7489b29cb3ef47d78dfd55794f338b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065254ebe67545639644fcbc6bd9fc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:39:00.288779 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-c1beab06-4e0f-4a6a-9e4e-dce4cb57cccd tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] 10.222.0.18 "GET /compute/v2.1/servers/72af7667-a283-4567-894f-2bd233c01001" status: 200 len: 1730 microversion: 2.20 time: 0.346031 Jun 24 16:39:00.300612 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 334/687] 10.222.0.18 () {60 vars in 1276 bytes} [Fri Jun 24 16:38:59 2022] GET /compute/v2.1/servers/72af7667-a283-4567-894f-2bd233c01001 => generated 1730 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 16:39:00.317097 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-b5f75218-e4bc-49c5-b164-d30069d83bfb tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Calling method '>' {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:39:00.317715 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-b5f75218-e4bc-49c5-b164-d30069d83bfb tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] [instance: 1c66f8ad-8bbd-4134-9f8c-7fdb0be9dc48] Fetching instance by UUID {{(pid=102148) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:39:00.335843 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-b5f75218-e4bc-49c5-b164-d30069d83bfb tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:39:00.337733 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-b5f75218-e4bc-49c5-b164-d30069d83bfb tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:39:00.339187 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-b5f75218-e4bc-49c5-b164-d30069d83bfb tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:39:00.340739 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-b5f75218-e4bc-49c5-b164-d30069d83bfb tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:39:00.434662 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.wsgi [None req-b5f75218-e4bc-49c5-b164-d30069d83bfb tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] HTTP exception thrown: Instance 1c66f8ad-8bbd-4134-9f8c-7fdb0be9dc48 could not be found. Jun 24 16:39:00.435841 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-b5f75218-e4bc-49c5-b164-d30069d83bfb tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Returning 404 to user: Instance 1c66f8ad-8bbd-4134-9f8c-7fdb0be9dc48 could not be found. {{(pid=102148) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jun 24 16:39:00.437520 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-b5f75218-e4bc-49c5-b164-d30069d83bfb tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] 10.222.0.18 "GET /compute/v2.1/servers/1c66f8ad-8bbd-4134-9f8c-7fdb0be9dc48" status: 404 len: 111 microversion: 2.1 time: 0.125166 Jun 24 16:39:00.438474 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 354/688] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:39:00 2022] GET /compute/v2.1/servers/1c66f8ad-8bbd-4134-9f8c-7fdb0be9dc48 => generated 111 bytes in 127 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 16:39:00.449818 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-5b2ae556-6e84-4fb4-92a1-8c9f139e5bbc tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Calling method '.version_select at 0x7f1ae2fec820>' {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:39:00.478547 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-5b2ae556-6e84-4fb4-92a1-8c9f139e5bbc tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1243260420" status: 202 len: 0 microversion: 2.1 time: 0.033607 Jun 24 16:39:00.481574 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 335/689] 10.222.0.18 () {58 vars in 1220 bytes} [Fri Jun 24 16:39:00 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1243260420 => generated 0 bytes in 37 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 24 16:39:01.310482 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-3bfb031c-2348-40f6-90dc-a3aef9d12920 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Calling method '>' {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:39:01.310482 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-3bfb031c-2348-40f6-90dc-a3aef9d12920 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] [instance: 72af7667-a283-4567-894f-2bd233c01001] Fetching instance by UUID {{(pid=102148) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:39:01.319896 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-3bfb031c-2348-40f6-90dc-a3aef9d12920 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:39:01.321099 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-3bfb031c-2348-40f6-90dc-a3aef9d12920 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:39:01.322079 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-3bfb031c-2348-40f6-90dc-a3aef9d12920 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:39:01.322719 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-3bfb031c-2348-40f6-90dc-a3aef9d12920 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:39:01.819278 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-3bfb031c-2348-40f6-90dc-a3aef9d12920 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7489b29cb3ef47d78dfd55794f338b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065254ebe67545639644fcbc6bd9fc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:39:01.830756 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-3bfb031c-2348-40f6-90dc-a3aef9d12920 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7489b29cb3ef47d78dfd55794f338b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065254ebe67545639644fcbc6bd9fc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:39:01.832288 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-3bfb031c-2348-40f6-90dc-a3aef9d12920 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7489b29cb3ef47d78dfd55794f338b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065254ebe67545639644fcbc6bd9fc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:39:01.833477 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-3bfb031c-2348-40f6-90dc-a3aef9d12920 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] 10.222.0.18 "GET /compute/v2.1/servers/72af7667-a283-4567-894f-2bd233c01001" status: 200 len: 1730 microversion: 2.20 time: 0.529307 Jun 24 16:39:01.852967 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 355/690] 10.222.0.18 () {60 vars in 1276 bytes} [Fri Jun 24 16:39:01 2022] GET /compute/v2.1/servers/72af7667-a283-4567-894f-2bd233c01001 => generated 1730 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 16:39:02.865790 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-e959c7a0-ade3-4e88-a31a-d97fabc64b1c tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Calling method '>' {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:39:02.866429 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-e959c7a0-ade3-4e88-a31a-d97fabc64b1c tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] [instance: 72af7667-a283-4567-894f-2bd233c01001] Fetching instance by UUID {{(pid=102149) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:39:02.879173 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-e959c7a0-ade3-4e88-a31a-d97fabc64b1c tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:39:02.880057 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-e959c7a0-ade3-4e88-a31a-d97fabc64b1c tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:39:02.881021 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-e959c7a0-ade3-4e88-a31a-d97fabc64b1c tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:39:02.881650 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-e959c7a0-ade3-4e88-a31a-d97fabc64b1c tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:39:03.120091 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-687e75ce-9061-4c93-ac34-bef0397fcb67 tempest-TestMinimumBasicScenario-1035681150 tempest-TestMinimumBasicScenario-1035681150-project] Action: 'create', calling method: .version_select at 0x7f1ae8d8a430>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1813564896", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNDVsja7rEgvsMFkjtOpNW2cce2UrubP1j2GN3iCXDhcHqPVjqL1fChiznQNExItTWsnL9dLhWSINCgJuryDCu4Q63oU8hFo7U7nIBX0cMwjASYVRxcpAval2CCZpPpnNA=="}} {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 16:39:03.153972 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.quota [None req-687e75ce-9061-4c93-ac34-bef0397fcb67 tempest-TestMinimumBasicScenario-1035681150 tempest-TestMinimumBasicScenario-1035681150-project] Getting quotas for project e2df211bdae44be6b7e0cc41c2cd11e4. Resources: {'key_pairs'} {{(pid=102148) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jun 24 16:39:03.160128 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.quota [None req-687e75ce-9061-4c93-ac34-bef0397fcb67 tempest-TestMinimumBasicScenario-1035681150 tempest-TestMinimumBasicScenario-1035681150-project] Getting quotas for user f875e9c85597441fb83cb9be8ddf91c1 and project e2df211bdae44be6b7e0cc41c2cd11e4. Resources: {'key_pairs'} {{(pid=102148) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jun 24 16:39:03.202650 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-687e75ce-9061-4c93-ac34-bef0397fcb67 tempest-TestMinimumBasicScenario-1035681150 tempest-TestMinimumBasicScenario-1035681150-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.086739 Jun 24 16:39:03.204108 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-e959c7a0-ade3-4e88-a31a-d97fabc64b1c tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7489b29cb3ef47d78dfd55794f338b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065254ebe67545639644fcbc6bd9fc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:39:03.207052 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 356/691] 10.222.0.18 () {60 vars in 1158 bytes} [Fri Jun 24 16:39:03 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 16:39:03.214127 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-e959c7a0-ade3-4e88-a31a-d97fabc64b1c tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7489b29cb3ef47d78dfd55794f338b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065254ebe67545639644fcbc6bd9fc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:39:03.216260 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-e959c7a0-ade3-4e88-a31a-d97fabc64b1c tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7489b29cb3ef47d78dfd55794f338b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065254ebe67545639644fcbc6bd9fc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:39:03.217274 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-e959c7a0-ade3-4e88-a31a-d97fabc64b1c tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] 10.222.0.18 "GET /compute/v2.1/servers/72af7667-a283-4567-894f-2bd233c01001" status: 200 len: 1730 microversion: 2.20 time: 0.359309 Jun 24 16:39:03.217998 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 336/692] 10.222.0.18 () {60 vars in 1276 bytes} [Fri Jun 24 16:39:02 2022] GET /compute/v2.1/servers/72af7667-a283-4567-894f-2bd233c01001 => generated 1730 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 16:39:03.274751 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-e2c7858b-a683-4bf2-a7e0-5d166fcfa2fa tempest-TestMinimumBasicScenario-1035681150 tempest-TestMinimumBasicScenario-1035681150-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-541446112", "imageRef": "e6008066-cbee-4c04-a4a3-63b7526b6025", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1813564896", "networks": [{"uuid": "2ca299b2-bbf3-454b-b3d7-c3b24ac05efb"}]}} {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 16:39:03.366655 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.network.neutron [None req-e2c7858b-a683-4bf2-a7e0-5d166fcfa2fa tempest-TestMinimumBasicScenario-1035681150 tempest-TestMinimumBasicScenario-1035681150-project] validate_networks() for [('2ca299b2-bbf3-454b-b3d7-c3b24ac05efb', None, None, None)] {{(pid=102148) validate_networks /opt/stack/nova/nova/network/neutron.py:2367}} Jun 24 16:39:04.020850 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [req-7b4f95b1-82d5-444b-88d0-15665ff6fb66 req-a3814331-18b4-4b58-b0e0-76b031d349e7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "72af7667-a283-4567-894f-2bd233c01001", "name": "network-vif-plugged", "status": "completed", "tag": "87b332d5-d83a-40ca-bb6b-503444dbbfbe"}]} {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 16:39:04.022407 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 24 16:39:04.022407 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: warnings.warn(msg) Jun 24 16:39:04.035411 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [req-7b4f95b1-82d5-444b-88d0-15665ff6fb66 req-a3814331-18b4-4b58-b0e0-76b031d349e7 service nova] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:39:04.035846 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [req-7b4f95b1-82d5-444b-88d0-15665ff6fb66 req-a3814331-18b4-4b58-b0e0-76b031d349e7 service nova] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:39:04.045254 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.virt.hardware [None req-e2c7858b-a683-4bf2-a7e0-5d166fcfa2fa tempest-TestMinimumBasicScenario-1035681150 tempest-TestMinimumBasicScenario-1035681150-project] Flavor limits 0:0:0 {{(pid=102148) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 24 16:39:04.046139 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.virt.hardware [None req-e2c7858b-a683-4bf2-a7e0-5d166fcfa2fa tempest-TestMinimumBasicScenario-1035681150 tempest-TestMinimumBasicScenario-1035681150-project] Image limits 0:0:0 {{(pid=102148) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 24 16:39:04.047358 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.virt.hardware [None req-e2c7858b-a683-4bf2-a7e0-5d166fcfa2fa tempest-TestMinimumBasicScenario-1035681150 tempest-TestMinimumBasicScenario-1035681150-project] Flavor pref 0:0:0 {{(pid=102148) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 24 16:39:04.048245 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.virt.hardware [None req-e2c7858b-a683-4bf2-a7e0-5d166fcfa2fa tempest-TestMinimumBasicScenario-1035681150 tempest-TestMinimumBasicScenario-1035681150-project] Image pref 0:0:0 {{(pid=102148) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 24 16:39:04.048784 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.virt.hardware [None req-e2c7858b-a683-4bf2-a7e0-5d166fcfa2fa tempest-TestMinimumBasicScenario-1035681150 tempest-TestMinimumBasicScenario-1035681150-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=102148) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 24 16:39:04.058516 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-e2c7858b-a683-4bf2-a7e0-5d166fcfa2fa tempest-TestMinimumBasicScenario-1035681150 tempest-TestMinimumBasicScenario-1035681150-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:39:04.059054 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-e2c7858b-a683-4bf2-a7e0-5d166fcfa2fa tempest-TestMinimumBasicScenario-1035681150 tempest-TestMinimumBasicScenario-1035681150-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:39:04.059874 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-e2c7858b-a683-4bf2-a7e0-5d166fcfa2fa tempest-TestMinimumBasicScenario-1035681150 tempest-TestMinimumBasicScenario-1035681150-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:39:04.060305 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-e2c7858b-a683-4bf2-a7e0-5d166fcfa2fa tempest-TestMinimumBasicScenario-1035681150 tempest-TestMinimumBasicScenario-1035681150-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:39:04.062720 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.compute.server_external_events [req-7b4f95b1-82d5-444b-88d0-15665ff6fb66 req-a3814331-18b4-4b58-b0e0-76b031d349e7 service nova] Creating event network-vif-plugged:87b332d5-d83a-40ca-bb6b-503444dbbfbe for instance 72af7667-a283-4567-894f-2bd233c01001 on hv-cinder-84718 Jun 24 16:39:04.068321 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [req-7b4f95b1-82d5-444b-88d0-15665ff6fb66 req-a3814331-18b4-4b58-b0e0-76b031d349e7 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051625 Jun 24 16:39:04.069031 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 337/693] 10.222.0.18 () {64 vars in 1317 bytes} [Fri Jun 24 16:39:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 16:39:04.093781 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.quota [None req-e2c7858b-a683-4bf2-a7e0-5d166fcfa2fa tempest-TestMinimumBasicScenario-1035681150 tempest-TestMinimumBasicScenario-1035681150-project] Getting quotas for project e2df211bdae44be6b7e0cc41c2cd11e4. Resources: {'ram', 'instances', 'cores'} {{(pid=102148) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jun 24 16:39:04.106806 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.quota [None req-e2c7858b-a683-4bf2-a7e0-5d166fcfa2fa tempest-TestMinimumBasicScenario-1035681150 tempest-TestMinimumBasicScenario-1035681150-project] Getting quotas for user f875e9c85597441fb83cb9be8ddf91c1 and project e2df211bdae44be6b7e0cc41c2cd11e4. Resources: {'ram', 'instances', 'cores'} {{(pid=102148) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jun 24 16:39:04.125659 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-e2c7858b-a683-4bf2-a7e0-5d166fcfa2fa tempest-TestMinimumBasicScenario-1035681150 tempest-TestMinimumBasicScenario-1035681150-project] Going to run 1 instances... {{(pid=102148) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Jun 24 16:39:04.130373 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-e2c7858b-a683-4bf2-a7e0-5d166fcfa2fa tempest-TestMinimumBasicScenario-1035681150 tempest-TestMinimumBasicScenario-1035681150-project] [instance: 121c5ed1-7baf-4e1a-b849-1c17079ff674] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e6008066-cbee-4c04-a4a3-63b7526b6025',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=102148) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1684}} Jun 24 16:39:04.200137 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-e2c7858b-a683-4bf2-a7e0-5d166fcfa2fa tempest-TestMinimumBasicScenario-1035681150 tempest-TestMinimumBasicScenario-1035681150-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.928475 Jun 24 16:39:04.201196 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 357/694] 10.222.0.18 () {60 vars in 1146 bytes} [Fri Jun 24 16:39:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 932 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 24 16:39:04.212334 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-9387de00-9f98-4c43-870d-4360be3e53ab tempest-TestMinimumBasicScenario-1035681150 tempest-TestMinimumBasicScenario-1035681150-project] Calling method '>' {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:39:04.213298 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-9387de00-9f98-4c43-870d-4360be3e53ab tempest-TestMinimumBasicScenario-1035681150 tempest-TestMinimumBasicScenario-1035681150-project] [instance: 121c5ed1-7baf-4e1a-b849-1c17079ff674] Fetching instance by UUID {{(pid=102149) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:39:04.246378 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-00ab67ea-5b7a-4211-97d5-f12d70f1269b tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Calling method '>' {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:39:04.247328 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-00ab67ea-5b7a-4211-97d5-f12d70f1269b tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] [instance: 72af7667-a283-4567-894f-2bd233c01001] Fetching instance by UUID {{(pid=102148) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:39:04.257969 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-00ab67ea-5b7a-4211-97d5-f12d70f1269b tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:39:04.258883 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-00ab67ea-5b7a-4211-97d5-f12d70f1269b tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:39:04.259933 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-00ab67ea-5b7a-4211-97d5-f12d70f1269b tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:39:04.260841 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-00ab67ea-5b7a-4211-97d5-f12d70f1269b tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:39:04.327654 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-9387de00-9f98-4c43-870d-4360be3e53ab tempest-TestMinimumBasicScenario-1035681150 tempest-TestMinimumBasicScenario-1035681150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f875e9c85597441fb83cb9be8ddf91c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2df211bdae44be6b7e0cc41c2cd11e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:39:04.346150 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-9387de00-9f98-4c43-870d-4360be3e53ab tempest-TestMinimumBasicScenario-1035681150 tempest-TestMinimumBasicScenario-1035681150-project] 10.222.0.18 "GET /compute/v2.1/servers/121c5ed1-7baf-4e1a-b849-1c17079ff674" status: 200 len: 1258 microversion: 2.1 time: 0.137420 Jun 24 16:39:04.354268 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 338/695] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:39:04 2022] GET /compute/v2.1/servers/121c5ed1-7baf-4e1a-b849-1c17079ff674 => generated 1258 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 16:39:04.462861 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-d0250363-65a7-4d26-a9c3-4972c857e413 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Calling method '>' {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:39:04.464174 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-d0250363-65a7-4d26-a9c3-4972c857e413 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] [instance: 1c66f8ad-8bbd-4134-9f8c-7fdb0be9dc48] Fetching instance by UUID {{(pid=102149) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:39:04.480914 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-d0250363-65a7-4d26-a9c3-4972c857e413 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:39:04.481409 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-d0250363-65a7-4d26-a9c3-4972c857e413 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:39:04.482865 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-d0250363-65a7-4d26-a9c3-4972c857e413 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:39:04.483664 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-d0250363-65a7-4d26-a9c3-4972c857e413 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:39:04.563558 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.wsgi [None req-d0250363-65a7-4d26-a9c3-4972c857e413 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] HTTP exception thrown: Instance 1c66f8ad-8bbd-4134-9f8c-7fdb0be9dc48 could not be found. Jun 24 16:39:04.564921 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-d0250363-65a7-4d26-a9c3-4972c857e413 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Returning 404 to user: Instance 1c66f8ad-8bbd-4134-9f8c-7fdb0be9dc48 could not be found. {{(pid=102149) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jun 24 16:39:04.566144 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-d0250363-65a7-4d26-a9c3-4972c857e413 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] 10.222.0.18 "DELETE /compute/v2.1/servers/1c66f8ad-8bbd-4134-9f8c-7fdb0be9dc48" status: 404 len: 111 microversion: 2.1 time: 0.111666 Jun 24 16:39:04.571638 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 339/696] 10.222.0.18 () {58 vars in 1238 bytes} [Fri Jun 24 16:39:04 2022] DELETE /compute/v2.1/servers/1c66f8ad-8bbd-4134-9f8c-7fdb0be9dc48 => generated 111 bytes in 114 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 16:39:04.581078 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-d16865e9-6860-4245-a9f9-5c1ce7478c5a tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Calling method '>' {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:39:04.581675 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-d16865e9-6860-4245-a9f9-5c1ce7478c5a tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] [instance: 1c66f8ad-8bbd-4134-9f8c-7fdb0be9dc48] Fetching instance by UUID {{(pid=102149) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:39:04.589983 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-d16865e9-6860-4245-a9f9-5c1ce7478c5a tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:39:04.590798 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-d16865e9-6860-4245-a9f9-5c1ce7478c5a tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:39:04.591575 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-d16865e9-6860-4245-a9f9-5c1ce7478c5a tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:39:04.592010 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-d16865e9-6860-4245-a9f9-5c1ce7478c5a tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:39:04.650508 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.wsgi [None req-d16865e9-6860-4245-a9f9-5c1ce7478c5a tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] HTTP exception thrown: Instance 1c66f8ad-8bbd-4134-9f8c-7fdb0be9dc48 could not be found. Jun 24 16:39:04.651134 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-d16865e9-6860-4245-a9f9-5c1ce7478c5a tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Returning 404 to user: Instance 1c66f8ad-8bbd-4134-9f8c-7fdb0be9dc48 could not be found. {{(pid=102149) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jun 24 16:39:04.651954 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-d16865e9-6860-4245-a9f9-5c1ce7478c5a tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] 10.222.0.18 "GET /compute/v2.1/servers/1c66f8ad-8bbd-4134-9f8c-7fdb0be9dc48" status: 404 len: 111 microversion: 2.1 time: 0.078638 Jun 24 16:39:04.652516 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 340/697] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:39:04 2022] GET /compute/v2.1/servers/1c66f8ad-8bbd-4134-9f8c-7fdb0be9dc48 => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 24 16:39:04.737558 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-00ab67ea-5b7a-4211-97d5-f12d70f1269b tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7489b29cb3ef47d78dfd55794f338b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065254ebe67545639644fcbc6bd9fc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:39:04.747815 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-00ab67ea-5b7a-4211-97d5-f12d70f1269b tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7489b29cb3ef47d78dfd55794f338b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065254ebe67545639644fcbc6bd9fc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:39:04.749481 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-00ab67ea-5b7a-4211-97d5-f12d70f1269b tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7489b29cb3ef47d78dfd55794f338b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065254ebe67545639644fcbc6bd9fc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:39:04.750636 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-00ab67ea-5b7a-4211-97d5-f12d70f1269b tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] 10.222.0.18 "GET /compute/v2.1/servers/72af7667-a283-4567-894f-2bd233c01001" status: 200 len: 1730 microversion: 2.20 time: 0.510832 Jun 24 16:39:04.752372 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 358/698] 10.222.0.18 () {60 vars in 1276 bytes} [Fri Jun 24 16:39:04 2022] GET /compute/v2.1/servers/72af7667-a283-4567-894f-2bd233c01001 => generated 1730 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 16:39:05.369733 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-81377a35-c1d7-46c9-93a7-f7531589ae99 tempest-TestMinimumBasicScenario-1035681150 tempest-TestMinimumBasicScenario-1035681150-project] Calling method '>' {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:39:05.370325 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-81377a35-c1d7-46c9-93a7-f7531589ae99 tempest-TestMinimumBasicScenario-1035681150 tempest-TestMinimumBasicScenario-1035681150-project] [instance: 121c5ed1-7baf-4e1a-b849-1c17079ff674] Fetching instance by UUID {{(pid=102149) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:39:05.378383 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-81377a35-c1d7-46c9-93a7-f7531589ae99 tempest-TestMinimumBasicScenario-1035681150 tempest-TestMinimumBasicScenario-1035681150-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:39:05.378864 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-81377a35-c1d7-46c9-93a7-f7531589ae99 tempest-TestMinimumBasicScenario-1035681150 tempest-TestMinimumBasicScenario-1035681150-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:39:05.379654 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-81377a35-c1d7-46c9-93a7-f7531589ae99 tempest-TestMinimumBasicScenario-1035681150 tempest-TestMinimumBasicScenario-1035681150-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:39:05.380090 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-81377a35-c1d7-46c9-93a7-f7531589ae99 tempest-TestMinimumBasicScenario-1035681150 tempest-TestMinimumBasicScenario-1035681150-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:39:05.508415 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-81377a35-c1d7-46c9-93a7-f7531589ae99 tempest-TestMinimumBasicScenario-1035681150 tempest-TestMinimumBasicScenario-1035681150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f875e9c85597441fb83cb9be8ddf91c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2df211bdae44be6b7e0cc41c2cd11e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:39:05.518032 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-81377a35-c1d7-46c9-93a7-f7531589ae99 tempest-TestMinimumBasicScenario-1035681150 tempest-TestMinimumBasicScenario-1035681150-project] 10.222.0.18 "GET /compute/v2.1/servers/121c5ed1-7baf-4e1a-b849-1c17079ff674" status: 200 len: 1310 microversion: 2.1 time: 0.152131 Jun 24 16:39:05.518621 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 341/699] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:39:05 2022] GET /compute/v2.1/servers/121c5ed1-7baf-4e1a-b849-1c17079ff674 => generated 1310 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 16:39:05.769743 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-b5158718-f47b-4c5a-b134-80d16fd75c76 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Calling method '>' {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:39:05.770376 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-b5158718-f47b-4c5a-b134-80d16fd75c76 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] [instance: 72af7667-a283-4567-894f-2bd233c01001] Fetching instance by UUID {{(pid=102148) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:39:05.789123 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-b5158718-f47b-4c5a-b134-80d16fd75c76 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:39:05.789668 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-b5158718-f47b-4c5a-b134-80d16fd75c76 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:39:05.790458 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-b5158718-f47b-4c5a-b134-80d16fd75c76 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:39:05.790945 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-b5158718-f47b-4c5a-b134-80d16fd75c76 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:39:05.935374 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-6fa64465-e7d4-4750-a80d-9ce6271c6163 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Calling method '>' {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:39:05.936122 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-6fa64465-e7d4-4750-a80d-9ce6271c6163 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] [instance: 41c16116-97cf-4394-8c41-2d57d447d422] Fetching instance by UUID {{(pid=102149) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:39:05.946059 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-6fa64465-e7d4-4750-a80d-9ce6271c6163 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:39:05.946510 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-6fa64465-e7d4-4750-a80d-9ce6271c6163 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:39:05.947339 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-6fa64465-e7d4-4750-a80d-9ce6271c6163 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:39:05.947787 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-6fa64465-e7d4-4750-a80d-9ce6271c6163 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:39:06.034078 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.wsgi [None req-6fa64465-e7d4-4750-a80d-9ce6271c6163 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] HTTP exception thrown: Instance 41c16116-97cf-4394-8c41-2d57d447d422 could not be found. Jun 24 16:39:06.035164 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-6fa64465-e7d4-4750-a80d-9ce6271c6163 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Returning 404 to user: Instance 41c16116-97cf-4394-8c41-2d57d447d422 could not be found. {{(pid=102149) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jun 24 16:39:06.036953 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-6fa64465-e7d4-4750-a80d-9ce6271c6163 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] 10.222.0.18 "DELETE /compute/v2.1/servers/41c16116-97cf-4394-8c41-2d57d447d422" status: 404 len: 111 microversion: 2.1 time: 0.119345 Jun 24 16:39:06.042603 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 342/700] 10.222.0.18 () {58 vars in 1238 bytes} [Fri Jun 24 16:39:05 2022] DELETE /compute/v2.1/servers/41c16116-97cf-4394-8c41-2d57d447d422 => generated 111 bytes in 126 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 16:39:06.051629 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-1736b59a-da49-4391-a432-98c9a3b40711 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Calling method '>' {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:39:06.052813 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-1736b59a-da49-4391-a432-98c9a3b40711 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] [instance: 41c16116-97cf-4394-8c41-2d57d447d422] Fetching instance by UUID {{(pid=102149) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:39:06.067496 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-1736b59a-da49-4391-a432-98c9a3b40711 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:39:06.067967 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-1736b59a-da49-4391-a432-98c9a3b40711 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:39:06.069037 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-1736b59a-da49-4391-a432-98c9a3b40711 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:39:06.069791 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-1736b59a-da49-4391-a432-98c9a3b40711 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:39:06.145706 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.wsgi [None req-1736b59a-da49-4391-a432-98c9a3b40711 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] HTTP exception thrown: Instance 41c16116-97cf-4394-8c41-2d57d447d422 could not be found. Jun 24 16:39:06.146431 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-1736b59a-da49-4391-a432-98c9a3b40711 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Returning 404 to user: Instance 41c16116-97cf-4394-8c41-2d57d447d422 could not be found. {{(pid=102149) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jun 24 16:39:06.147365 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-1736b59a-da49-4391-a432-98c9a3b40711 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] 10.222.0.18 "GET /compute/v2.1/servers/41c16116-97cf-4394-8c41-2d57d447d422" status: 404 len: 111 microversion: 2.1 time: 0.103289 Jun 24 16:39:06.147885 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 343/701] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:39:06 2022] GET /compute/v2.1/servers/41c16116-97cf-4394-8c41-2d57d447d422 => generated 111 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 16:39:06.161624 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-4bf58944-44c8-497b-b858-907edc2e5ae8 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Calling method '>' {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:39:06.161934 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-4bf58944-44c8-497b-b858-907edc2e5ae8 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] [instance: 24dce890-4ccc-4122-8b62-438ea395fb9a] Fetching instance by UUID {{(pid=102149) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:39:06.170633 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-4bf58944-44c8-497b-b858-907edc2e5ae8 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:39:06.171273 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-4bf58944-44c8-497b-b858-907edc2e5ae8 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:39:06.172085 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-4bf58944-44c8-497b-b858-907edc2e5ae8 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:39:06.173558 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-4bf58944-44c8-497b-b858-907edc2e5ae8 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:39:06.262617 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.wsgi [None req-4bf58944-44c8-497b-b858-907edc2e5ae8 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] HTTP exception thrown: Instance 24dce890-4ccc-4122-8b62-438ea395fb9a could not be found. Jun 24 16:39:06.263273 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-4bf58944-44c8-497b-b858-907edc2e5ae8 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Returning 404 to user: Instance 24dce890-4ccc-4122-8b62-438ea395fb9a could not be found. {{(pid=102149) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jun 24 16:39:06.264301 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-4bf58944-44c8-497b-b858-907edc2e5ae8 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] 10.222.0.18 "DELETE /compute/v2.1/servers/24dce890-4ccc-4122-8b62-438ea395fb9a" status: 404 len: 111 microversion: 2.1 time: 0.109406 Jun 24 16:39:06.264862 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 344/702] 10.222.0.18 () {58 vars in 1238 bytes} [Fri Jun 24 16:39:06 2022] DELETE /compute/v2.1/servers/24dce890-4ccc-4122-8b62-438ea395fb9a => generated 111 bytes in 112 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 24 16:39:06.279371 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-f8148472-5a63-4f67-8505-05410cd9bf0f tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Calling method '>' {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:39:06.280162 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-f8148472-5a63-4f67-8505-05410cd9bf0f tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] [instance: 24dce890-4ccc-4122-8b62-438ea395fb9a] Fetching instance by UUID {{(pid=102149) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:39:06.295077 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-b5158718-f47b-4c5a-b134-80d16fd75c76 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7489b29cb3ef47d78dfd55794f338b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065254ebe67545639644fcbc6bd9fc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:39:06.304029 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-f8148472-5a63-4f67-8505-05410cd9bf0f tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:39:06.305561 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-f8148472-5a63-4f67-8505-05410cd9bf0f tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:39:06.308260 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-b5158718-f47b-4c5a-b134-80d16fd75c76 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7489b29cb3ef47d78dfd55794f338b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065254ebe67545639644fcbc6bd9fc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:39:06.308982 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-f8148472-5a63-4f67-8505-05410cd9bf0f tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:39:06.308982 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-f8148472-5a63-4f67-8505-05410cd9bf0f tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:39:06.310212 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-b5158718-f47b-4c5a-b134-80d16fd75c76 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7489b29cb3ef47d78dfd55794f338b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065254ebe67545639644fcbc6bd9fc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:39:06.312062 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-b5158718-f47b-4c5a-b134-80d16fd75c76 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] 10.222.0.18 "GET /compute/v2.1/servers/72af7667-a283-4567-894f-2bd233c01001" status: 200 len: 1730 microversion: 2.20 time: 0.547085 Jun 24 16:39:06.314267 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 359/703] 10.222.0.18 () {60 vars in 1276 bytes} [Fri Jun 24 16:39:05 2022] GET /compute/v2.1/servers/72af7667-a283-4567-894f-2bd233c01001 => generated 1730 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 16:39:06.436842 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.wsgi [None req-f8148472-5a63-4f67-8505-05410cd9bf0f tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] HTTP exception thrown: Instance 24dce890-4ccc-4122-8b62-438ea395fb9a could not be found. Jun 24 16:39:06.441916 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-f8148472-5a63-4f67-8505-05410cd9bf0f tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Returning 404 to user: Instance 24dce890-4ccc-4122-8b62-438ea395fb9a could not be found. {{(pid=102149) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jun 24 16:39:06.448463 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-f8148472-5a63-4f67-8505-05410cd9bf0f tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] 10.222.0.18 "GET /compute/v2.1/servers/24dce890-4ccc-4122-8b62-438ea395fb9a" status: 404 len: 111 microversion: 2.1 time: 0.171506 Jun 24 16:39:06.472902 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 345/704] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:39:06 2022] GET /compute/v2.1/servers/24dce890-4ccc-4122-8b62-438ea395fb9a => generated 111 bytes in 201 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 16:39:06.537002 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-ca87ed35-d373-4028-bb8d-c565f3a45e76 tempest-TestMinimumBasicScenario-1035681150 tempest-TestMinimumBasicScenario-1035681150-project] Calling method '>' {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:39:06.537430 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-ca87ed35-d373-4028-bb8d-c565f3a45e76 tempest-TestMinimumBasicScenario-1035681150 tempest-TestMinimumBasicScenario-1035681150-project] [instance: 121c5ed1-7baf-4e1a-b849-1c17079ff674] Fetching instance by UUID {{(pid=102148) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:39:06.557924 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-ca87ed35-d373-4028-bb8d-c565f3a45e76 tempest-TestMinimumBasicScenario-1035681150 tempest-TestMinimumBasicScenario-1035681150-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:39:06.558794 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-ca87ed35-d373-4028-bb8d-c565f3a45e76 tempest-TestMinimumBasicScenario-1035681150 tempest-TestMinimumBasicScenario-1035681150-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:39:06.566588 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-ca87ed35-d373-4028-bb8d-c565f3a45e76 tempest-TestMinimumBasicScenario-1035681150 tempest-TestMinimumBasicScenario-1035681150-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:39:06.568881 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-ca87ed35-d373-4028-bb8d-c565f3a45e76 tempest-TestMinimumBasicScenario-1035681150 tempest-TestMinimumBasicScenario-1035681150-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:39:06.891155 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-ca87ed35-d373-4028-bb8d-c565f3a45e76 tempest-TestMinimumBasicScenario-1035681150 tempest-TestMinimumBasicScenario-1035681150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f875e9c85597441fb83cb9be8ddf91c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2df211bdae44be6b7e0cc41c2cd11e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:39:06.901850 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-ca87ed35-d373-4028-bb8d-c565f3a45e76 tempest-TestMinimumBasicScenario-1035681150 tempest-TestMinimumBasicScenario-1035681150-project] 10.222.0.18 "GET /compute/v2.1/servers/121c5ed1-7baf-4e1a-b849-1c17079ff674" status: 200 len: 1316 microversion: 2.1 time: 0.369974 Jun 24 16:39:06.909085 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 360/705] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:39:06 2022] GET /compute/v2.1/servers/121c5ed1-7baf-4e1a-b849-1c17079ff674 => generated 1316 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 16:39:07.345546 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-85d004ba-e8f7-41f0-8a3c-0632e02bc981 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Calling method '>' {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:39:07.349624 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-85d004ba-e8f7-41f0-8a3c-0632e02bc981 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] [instance: 72af7667-a283-4567-894f-2bd233c01001] Fetching instance by UUID {{(pid=102149) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:39:07.383416 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-85d004ba-e8f7-41f0-8a3c-0632e02bc981 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:39:07.390036 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-85d004ba-e8f7-41f0-8a3c-0632e02bc981 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:39:07.391204 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-85d004ba-e8f7-41f0-8a3c-0632e02bc981 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:39:07.399153 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-85d004ba-e8f7-41f0-8a3c-0632e02bc981 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:39:07.918288 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-85d004ba-e8f7-41f0-8a3c-0632e02bc981 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7489b29cb3ef47d78dfd55794f338b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065254ebe67545639644fcbc6bd9fc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:39:07.932614 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-3fe68bbd-cf20-4408-b56b-19ed177c610b tempest-TestMinimumBasicScenario-1035681150 tempest-TestMinimumBasicScenario-1035681150-project] Calling method '>' {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:39:07.933699 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-3fe68bbd-cf20-4408-b56b-19ed177c610b tempest-TestMinimumBasicScenario-1035681150 tempest-TestMinimumBasicScenario-1035681150-project] [instance: 121c5ed1-7baf-4e1a-b849-1c17079ff674] Fetching instance by UUID {{(pid=102148) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:39:07.956668 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-85d004ba-e8f7-41f0-8a3c-0632e02bc981 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7489b29cb3ef47d78dfd55794f338b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065254ebe67545639644fcbc6bd9fc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:39:07.959179 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-85d004ba-e8f7-41f0-8a3c-0632e02bc981 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7489b29cb3ef47d78dfd55794f338b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065254ebe67545639644fcbc6bd9fc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:39:07.960901 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-85d004ba-e8f7-41f0-8a3c-0632e02bc981 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] 10.222.0.18 "GET /compute/v2.1/servers/72af7667-a283-4567-894f-2bd233c01001" status: 200 len: 1717 microversion: 2.20 time: 0.623408 Jun 24 16:39:07.962645 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 346/706] 10.222.0.18 () {60 vars in 1276 bytes} [Fri Jun 24 16:39:07 2022] GET /compute/v2.1/servers/72af7667-a283-4567-894f-2bd233c01001 => generated 1717 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 16:39:07.965831 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-3fe68bbd-cf20-4408-b56b-19ed177c610b tempest-TestMinimumBasicScenario-1035681150 tempest-TestMinimumBasicScenario-1035681150-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:39:07.966574 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-3fe68bbd-cf20-4408-b56b-19ed177c610b tempest-TestMinimumBasicScenario-1035681150 tempest-TestMinimumBasicScenario-1035681150-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:39:07.967420 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-3fe68bbd-cf20-4408-b56b-19ed177c610b tempest-TestMinimumBasicScenario-1035681150 tempest-TestMinimumBasicScenario-1035681150-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:39:07.967931 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-3fe68bbd-cf20-4408-b56b-19ed177c610b tempest-TestMinimumBasicScenario-1035681150 tempest-TestMinimumBasicScenario-1035681150-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:39:07.974517 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-70942641-8320-4bb8-bf6b-85e068ff5ba3 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Calling method '>' {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:39:07.980073 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-70942641-8320-4bb8-bf6b-85e068ff5ba3 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] [instance: 2fa4f019-3cbd-4b41-a0fc-6513f46474c0] Fetching instance by UUID {{(pid=102149) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:39:07.998304 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-70942641-8320-4bb8-bf6b-85e068ff5ba3 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:39:08.000356 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-70942641-8320-4bb8-bf6b-85e068ff5ba3 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:39:08.002552 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-70942641-8320-4bb8-bf6b-85e068ff5ba3 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:39:08.003322 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-70942641-8320-4bb8-bf6b-85e068ff5ba3 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:39:08.101969 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.wsgi [None req-70942641-8320-4bb8-bf6b-85e068ff5ba3 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] HTTP exception thrown: Instance 2fa4f019-3cbd-4b41-a0fc-6513f46474c0 could not be found. Jun 24 16:39:08.103759 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-70942641-8320-4bb8-bf6b-85e068ff5ba3 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Returning 404 to user: Instance 2fa4f019-3cbd-4b41-a0fc-6513f46474c0 could not be found. {{(pid=102149) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jun 24 16:39:08.104636 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-70942641-8320-4bb8-bf6b-85e068ff5ba3 tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] 10.222.0.18 "DELETE /compute/v2.1/servers/2fa4f019-3cbd-4b41-a0fc-6513f46474c0" status: 404 len: 111 microversion: 2.1 time: 0.139542 Jun 24 16:39:08.106846 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 347/707] 10.222.0.18 () {58 vars in 1238 bytes} [Fri Jun 24 16:39:07 2022] DELETE /compute/v2.1/servers/2fa4f019-3cbd-4b41-a0fc-6513f46474c0 => generated 111 bytes in 143 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 16:39:08.114182 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-5ed5c53c-3c84-4293-99da-138c42e5740a tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Calling method '>' {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:39:08.114824 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-5ed5c53c-3c84-4293-99da-138c42e5740a tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] [instance: 2fa4f019-3cbd-4b41-a0fc-6513f46474c0] Fetching instance by UUID {{(pid=102149) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:39:08.124196 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-5ed5c53c-3c84-4293-99da-138c42e5740a tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:39:08.124670 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-5ed5c53c-3c84-4293-99da-138c42e5740a tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:39:08.125642 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-5ed5c53c-3c84-4293-99da-138c42e5740a tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:39:08.127094 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-5ed5c53c-3c84-4293-99da-138c42e5740a tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:39:08.213867 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.wsgi [None req-5ed5c53c-3c84-4293-99da-138c42e5740a tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] HTTP exception thrown: Instance 2fa4f019-3cbd-4b41-a0fc-6513f46474c0 could not be found. Jun 24 16:39:08.214947 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-5ed5c53c-3c84-4293-99da-138c42e5740a tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] Returning 404 to user: Instance 2fa4f019-3cbd-4b41-a0fc-6513f46474c0 could not be found. {{(pid=102149) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jun 24 16:39:08.216168 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-5ed5c53c-3c84-4293-99da-138c42e5740a tempest-AttachVolumeNegativeTest-928851823 tempest-AttachVolumeNegativeTest-928851823-project] 10.222.0.18 "GET /compute/v2.1/servers/2fa4f019-3cbd-4b41-a0fc-6513f46474c0" status: 404 len: 111 microversion: 2.1 time: 0.105587 Jun 24 16:39:08.217117 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 348/708] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:39:08 2022] GET /compute/v2.1/servers/2fa4f019-3cbd-4b41-a0fc-6513f46474c0 => generated 111 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 16:39:08.759738 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-3fe68bbd-cf20-4408-b56b-19ed177c610b tempest-TestMinimumBasicScenario-1035681150 tempest-TestMinimumBasicScenario-1035681150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f875e9c85597441fb83cb9be8ddf91c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2df211bdae44be6b7e0cc41c2cd11e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:39:08.770059 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-3fe68bbd-cf20-4408-b56b-19ed177c610b tempest-TestMinimumBasicScenario-1035681150 tempest-TestMinimumBasicScenario-1035681150-project] 10.222.0.18 "GET /compute/v2.1/servers/121c5ed1-7baf-4e1a-b849-1c17079ff674" status: 200 len: 1358 microversion: 2.1 time: 0.843494 Jun 24 16:39:08.773026 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 361/709] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:39:07 2022] GET /compute/v2.1/servers/121c5ed1-7baf-4e1a-b849-1c17079ff674 => generated 1358 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 16:39:09.787712 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-9ff749f6-abd6-43e3-a4f4-c2304966127f tempest-TestMinimumBasicScenario-1035681150 tempest-TestMinimumBasicScenario-1035681150-project] Calling method '>' {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:39:09.788641 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-9ff749f6-abd6-43e3-a4f4-c2304966127f tempest-TestMinimumBasicScenario-1035681150 tempest-TestMinimumBasicScenario-1035681150-project] [instance: 121c5ed1-7baf-4e1a-b849-1c17079ff674] Fetching instance by UUID {{(pid=102149) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:39:09.813221 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-9ff749f6-abd6-43e3-a4f4-c2304966127f tempest-TestMinimumBasicScenario-1035681150 tempest-TestMinimumBasicScenario-1035681150-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:39:09.813599 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-9ff749f6-abd6-43e3-a4f4-c2304966127f tempest-TestMinimumBasicScenario-1035681150 tempest-TestMinimumBasicScenario-1035681150-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:39:09.814464 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-9ff749f6-abd6-43e3-a4f4-c2304966127f tempest-TestMinimumBasicScenario-1035681150 tempest-TestMinimumBasicScenario-1035681150-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:39:09.825725 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-9ff749f6-abd6-43e3-a4f4-c2304966127f tempest-TestMinimumBasicScenario-1035681150 tempest-TestMinimumBasicScenario-1035681150-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:39:10.207377 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [req-de529e79-3c45-4597-a2ba-f0db3f2981df req-75441a60-6dfa-444f-891f-5dbd13abd39b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "121c5ed1-7baf-4e1a-b849-1c17079ff674", "tag": "688e29ea-2634-442c-8941-c7390b7f3cc6"}]} {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 16:39:10.215928 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 24 16:39:10.215928 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: warnings.warn(msg) Jun 24 16:39:10.278248 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [req-de529e79-3c45-4597-a2ba-f0db3f2981df req-75441a60-6dfa-444f-891f-5dbd13abd39b service nova] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:39:10.278806 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [req-de529e79-3c45-4597-a2ba-f0db3f2981df req-75441a60-6dfa-444f-891f-5dbd13abd39b service nova] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:39:10.360164 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.compute.server_external_events [req-de529e79-3c45-4597-a2ba-f0db3f2981df req-75441a60-6dfa-444f-891f-5dbd13abd39b service nova] Creating event network-changed:688e29ea-2634-442c-8941-c7390b7f3cc6 for instance 121c5ed1-7baf-4e1a-b849-1c17079ff674 on hv-cinder-84718 Jun 24 16:39:10.382008 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [req-de529e79-3c45-4597-a2ba-f0db3f2981df req-75441a60-6dfa-444f-891f-5dbd13abd39b service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.193009 Jun 24 16:39:10.388087 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 362/710] 10.222.0.18 () {64 vars in 1317 bytes} [Fri Jun 24 16:39:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 16:39:10.475086 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-ea9aecde-9352-41ab-a331-923567a306e4 tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 16:39:10.476757 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-ea9aecde-9352-41ab-a331-923567a306e4 tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] [instance: bd57f4a8-0078-4dde-ac34-901a40bc7b8e] Fetching instance by UUID {{(pid=102148) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:39:10.509448 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-ea9aecde-9352-41ab-a331-923567a306e4 tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:39:10.512254 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-9ff749f6-abd6-43e3-a4f4-c2304966127f tempest-TestMinimumBasicScenario-1035681150 tempest-TestMinimumBasicScenario-1035681150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f875e9c85597441fb83cb9be8ddf91c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2df211bdae44be6b7e0cc41c2cd11e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:39:10.513219 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-ea9aecde-9352-41ab-a331-923567a306e4 tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:39:10.514290 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-ea9aecde-9352-41ab-a331-923567a306e4 tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:39:10.515044 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-ea9aecde-9352-41ab-a331-923567a306e4 tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:39:10.524964 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-9ff749f6-abd6-43e3-a4f4-c2304966127f tempest-TestMinimumBasicScenario-1035681150 tempest-TestMinimumBasicScenario-1035681150-project] 10.222.0.18 "GET /compute/v2.1/servers/121c5ed1-7baf-4e1a-b849-1c17079ff674" status: 200 len: 1358 microversion: 2.1 time: 0.741450 Jun 24 16:39:10.536078 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 349/711] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:39:09 2022] GET /compute/v2.1/servers/121c5ed1-7baf-4e1a-b849-1c17079ff674 => generated 1358 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 16:39:10.686151 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.objects.instance [None req-ea9aecde-9352-41ab-a331-923567a306e4 tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] Lazy-loading 'flavor' on Instance uuid bd57f4a8-0078-4dde-ac34-901a40bc7b8e {{(pid=102148) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Jun 24 16:39:11.095645 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-ea9aecde-9352-41ab-a331-923567a306e4 tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] 10.222.0.18 "POST /compute/v2.1/servers/bd57f4a8-0078-4dde-ac34-901a40bc7b8e/action" status: 202 len: 0 microversion: 2.1 time: 0.634934 Jun 24 16:39:11.107198 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 363/712] 10.222.0.18 () {60 vars in 1277 bytes} [Fri Jun 24 16:39:10 2022] POST /compute/v2.1/servers/bd57f4a8-0078-4dde-ac34-901a40bc7b8e/action => generated 0 bytes in 649 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 24 16:39:11.112530 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-d4efc8b6-ed1b-43ba-818f-5b10af435422 tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] Calling method '>' {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:39:11.116658 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-d4efc8b6-ed1b-43ba-818f-5b10af435422 tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] [instance: bd57f4a8-0078-4dde-ac34-901a40bc7b8e] Fetching instance by UUID {{(pid=102149) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:39:11.146841 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-d4efc8b6-ed1b-43ba-818f-5b10af435422 tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:39:11.147485 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-d4efc8b6-ed1b-43ba-818f-5b10af435422 tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:39:11.149311 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-d4efc8b6-ed1b-43ba-818f-5b10af435422 tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:39:11.149973 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-d4efc8b6-ed1b-43ba-818f-5b10af435422 tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:39:11.545388 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-43655d58-06be-4892-b44d-c6ea15c54290 tempest-TestMinimumBasicScenario-1035681150 tempest-TestMinimumBasicScenario-1035681150-project] Calling method '>' {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:39:11.546418 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-43655d58-06be-4892-b44d-c6ea15c54290 tempest-TestMinimumBasicScenario-1035681150 tempest-TestMinimumBasicScenario-1035681150-project] [instance: 121c5ed1-7baf-4e1a-b849-1c17079ff674] Fetching instance by UUID {{(pid=102148) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:39:11.563901 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-43655d58-06be-4892-b44d-c6ea15c54290 tempest-TestMinimumBasicScenario-1035681150 tempest-TestMinimumBasicScenario-1035681150-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:39:11.565383 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-43655d58-06be-4892-b44d-c6ea15c54290 tempest-TestMinimumBasicScenario-1035681150 tempest-TestMinimumBasicScenario-1035681150-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:39:11.570276 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-43655d58-06be-4892-b44d-c6ea15c54290 tempest-TestMinimumBasicScenario-1035681150 tempest-TestMinimumBasicScenario-1035681150-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:39:11.571169 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-43655d58-06be-4892-b44d-c6ea15c54290 tempest-TestMinimumBasicScenario-1035681150 tempest-TestMinimumBasicScenario-1035681150-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:39:11.582938 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-d4efc8b6-ed1b-43ba-818f-5b10af435422 tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b823267a02a465192aadb5a1c5a3d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34b225f93234ca38c8d0c3d37ba0b8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:39:11.594077 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-d4efc8b6-ed1b-43ba-818f-5b10af435422 tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] 10.222.0.18 "GET /compute/v2.1/servers/bd57f4a8-0078-4dde-ac34-901a40bc7b8e" status: 200 len: 1569 microversion: 2.1 time: 0.488196 Jun 24 16:39:11.605333 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 350/713] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:39:11 2022] GET /compute/v2.1/servers/bd57f4a8-0078-4dde-ac34-901a40bc7b8e => generated 1569 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 16:39:11.852347 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-43655d58-06be-4892-b44d-c6ea15c54290 tempest-TestMinimumBasicScenario-1035681150 tempest-TestMinimumBasicScenario-1035681150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f875e9c85597441fb83cb9be8ddf91c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2df211bdae44be6b7e0cc41c2cd11e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:39:11.869580 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-43655d58-06be-4892-b44d-c6ea15c54290 tempest-TestMinimumBasicScenario-1035681150 tempest-TestMinimumBasicScenario-1035681150-project] 10.222.0.18 "GET /compute/v2.1/servers/121c5ed1-7baf-4e1a-b849-1c17079ff674" status: 200 len: 1358 microversion: 2.1 time: 0.328399 Jun 24 16:39:11.870816 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 364/714] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:39:11 2022] GET /compute/v2.1/servers/121c5ed1-7baf-4e1a-b849-1c17079ff674 => generated 1358 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 16:39:12.621450 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-315f64d0-0918-489d-a65a-9f881ed7fc82 tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] Calling method '>' {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:39:12.623165 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-315f64d0-0918-489d-a65a-9f881ed7fc82 tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] [instance: bd57f4a8-0078-4dde-ac34-901a40bc7b8e] Fetching instance by UUID {{(pid=102149) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:39:12.634053 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-315f64d0-0918-489d-a65a-9f881ed7fc82 tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:39:12.634875 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-315f64d0-0918-489d-a65a-9f881ed7fc82 tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:39:12.636032 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-315f64d0-0918-489d-a65a-9f881ed7fc82 tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:39:12.636544 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-315f64d0-0918-489d-a65a-9f881ed7fc82 tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:39:12.889471 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-74e5a1dd-cee5-47c1-a0d1-0737d60ddf16 tempest-TestMinimumBasicScenario-1035681150 tempest-TestMinimumBasicScenario-1035681150-project] Calling method '>' {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:39:12.897573 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-74e5a1dd-cee5-47c1-a0d1-0737d60ddf16 tempest-TestMinimumBasicScenario-1035681150 tempest-TestMinimumBasicScenario-1035681150-project] [instance: 121c5ed1-7baf-4e1a-b849-1c17079ff674] Fetching instance by UUID {{(pid=102148) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:39:12.903347 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-74e5a1dd-cee5-47c1-a0d1-0737d60ddf16 tempest-TestMinimumBasicScenario-1035681150 tempest-TestMinimumBasicScenario-1035681150-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:39:12.904068 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-74e5a1dd-cee5-47c1-a0d1-0737d60ddf16 tempest-TestMinimumBasicScenario-1035681150 tempest-TestMinimumBasicScenario-1035681150-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:39:12.905163 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-74e5a1dd-cee5-47c1-a0d1-0737d60ddf16 tempest-TestMinimumBasicScenario-1035681150 tempest-TestMinimumBasicScenario-1035681150-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:39:12.905674 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-74e5a1dd-cee5-47c1-a0d1-0737d60ddf16 tempest-TestMinimumBasicScenario-1035681150 tempest-TestMinimumBasicScenario-1035681150-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:39:13.048896 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-315f64d0-0918-489d-a65a-9f881ed7fc82 tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b823267a02a465192aadb5a1c5a3d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34b225f93234ca38c8d0c3d37ba0b8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:39:13.087853 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-315f64d0-0918-489d-a65a-9f881ed7fc82 tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] 10.222.0.18 "GET /compute/v2.1/servers/bd57f4a8-0078-4dde-ac34-901a40bc7b8e" status: 200 len: 1569 microversion: 2.1 time: 0.468256 Jun 24 16:39:13.091597 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 351/715] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:39:12 2022] GET /compute/v2.1/servers/bd57f4a8-0078-4dde-ac34-901a40bc7b8e => generated 1569 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 16:39:13.711473 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-74e5a1dd-cee5-47c1-a0d1-0737d60ddf16 tempest-TestMinimumBasicScenario-1035681150 tempest-TestMinimumBasicScenario-1035681150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f875e9c85597441fb83cb9be8ddf91c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2df211bdae44be6b7e0cc41c2cd11e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:39:13.728726 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-74e5a1dd-cee5-47c1-a0d1-0737d60ddf16 tempest-TestMinimumBasicScenario-1035681150 tempest-TestMinimumBasicScenario-1035681150-project] 10.222.0.18 "GET /compute/v2.1/servers/121c5ed1-7baf-4e1a-b849-1c17079ff674" status: 200 len: 1358 microversion: 2.1 time: 0.843669 Jun 24 16:39:13.729315 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 365/716] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:39:12 2022] GET /compute/v2.1/servers/121c5ed1-7baf-4e1a-b849-1c17079ff674 => generated 1358 bytes in 845 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 16:39:14.105453 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-aabdde06-07ac-4cd1-bdc0-666a5791cbc7 tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] Calling method '>' {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:39:14.106326 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-aabdde06-07ac-4cd1-bdc0-666a5791cbc7 tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] [instance: bd57f4a8-0078-4dde-ac34-901a40bc7b8e] Fetching instance by UUID {{(pid=102149) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:39:14.126477 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-aabdde06-07ac-4cd1-bdc0-666a5791cbc7 tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:39:14.127551 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-aabdde06-07ac-4cd1-bdc0-666a5791cbc7 tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:39:14.128737 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-aabdde06-07ac-4cd1-bdc0-666a5791cbc7 tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:39:14.135630 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-aabdde06-07ac-4cd1-bdc0-666a5791cbc7 tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:39:14.555199 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-aabdde06-07ac-4cd1-bdc0-666a5791cbc7 tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b823267a02a465192aadb5a1c5a3d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34b225f93234ca38c8d0c3d37ba0b8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:39:14.571897 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-aabdde06-07ac-4cd1-bdc0-666a5791cbc7 tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] 10.222.0.18 "GET /compute/v2.1/servers/bd57f4a8-0078-4dde-ac34-901a40bc7b8e" status: 200 len: 1569 microversion: 2.1 time: 0.470038 Jun 24 16:39:14.572529 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 352/717] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:39:14 2022] GET /compute/v2.1/servers/bd57f4a8-0078-4dde-ac34-901a40bc7b8e => generated 1569 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 16:39:14.746883 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-f9422d86-0b16-4d37-b5d3-468cd2f40081 tempest-TestMinimumBasicScenario-1035681150 tempest-TestMinimumBasicScenario-1035681150-project] Calling method '>' {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:39:14.747621 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-f9422d86-0b16-4d37-b5d3-468cd2f40081 tempest-TestMinimumBasicScenario-1035681150 tempest-TestMinimumBasicScenario-1035681150-project] [instance: 121c5ed1-7baf-4e1a-b849-1c17079ff674] Fetching instance by UUID {{(pid=102148) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:39:14.755659 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-f9422d86-0b16-4d37-b5d3-468cd2f40081 tempest-TestMinimumBasicScenario-1035681150 tempest-TestMinimumBasicScenario-1035681150-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:39:14.756148 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-f9422d86-0b16-4d37-b5d3-468cd2f40081 tempest-TestMinimumBasicScenario-1035681150 tempest-TestMinimumBasicScenario-1035681150-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:39:14.756930 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-f9422d86-0b16-4d37-b5d3-468cd2f40081 tempest-TestMinimumBasicScenario-1035681150 tempest-TestMinimumBasicScenario-1035681150-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:39:14.757360 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-f9422d86-0b16-4d37-b5d3-468cd2f40081 tempest-TestMinimumBasicScenario-1035681150 tempest-TestMinimumBasicScenario-1035681150-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:39:15.288153 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-f9422d86-0b16-4d37-b5d3-468cd2f40081 tempest-TestMinimumBasicScenario-1035681150 tempest-TestMinimumBasicScenario-1035681150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f875e9c85597441fb83cb9be8ddf91c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2df211bdae44be6b7e0cc41c2cd11e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:39:15.301602 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-f9422d86-0b16-4d37-b5d3-468cd2f40081 tempest-TestMinimumBasicScenario-1035681150 tempest-TestMinimumBasicScenario-1035681150-project] 10.222.0.18 "GET /compute/v2.1/servers/121c5ed1-7baf-4e1a-b849-1c17079ff674" status: 200 len: 1358 microversion: 2.1 time: 0.558697 Jun 24 16:39:15.329690 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 366/718] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:39:14 2022] GET /compute/v2.1/servers/121c5ed1-7baf-4e1a-b849-1c17079ff674 => generated 1358 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 16:39:15.591179 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-5940ba04-0e0a-408d-816a-904db9f79927 tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] Calling method '>' {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:39:15.591794 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-5940ba04-0e0a-408d-816a-904db9f79927 tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] [instance: bd57f4a8-0078-4dde-ac34-901a40bc7b8e] Fetching instance by UUID {{(pid=102149) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:39:15.607024 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-5940ba04-0e0a-408d-816a-904db9f79927 tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:39:15.607541 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-5940ba04-0e0a-408d-816a-904db9f79927 tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:39:15.608531 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-5940ba04-0e0a-408d-816a-904db9f79927 tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:39:15.609126 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-5940ba04-0e0a-408d-816a-904db9f79927 tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:39:16.062735 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-5940ba04-0e0a-408d-816a-904db9f79927 tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b823267a02a465192aadb5a1c5a3d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34b225f93234ca38c8d0c3d37ba0b8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:39:16.083706 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-5940ba04-0e0a-408d-816a-904db9f79927 tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] 10.222.0.18 "GET /compute/v2.1/servers/bd57f4a8-0078-4dde-ac34-901a40bc7b8e" status: 200 len: 1569 microversion: 2.1 time: 0.495610 Jun 24 16:39:16.086053 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 353/719] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:39:15 2022] GET /compute/v2.1/servers/bd57f4a8-0078-4dde-ac34-901a40bc7b8e => generated 1569 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 16:39:16.318985 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-8ca04c24-c65b-498a-9c98-6cf950363055 tempest-TestMinimumBasicScenario-1035681150 tempest-TestMinimumBasicScenario-1035681150-project] Calling method '>' {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:39:16.319626 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-8ca04c24-c65b-498a-9c98-6cf950363055 tempest-TestMinimumBasicScenario-1035681150 tempest-TestMinimumBasicScenario-1035681150-project] [instance: 121c5ed1-7baf-4e1a-b849-1c17079ff674] Fetching instance by UUID {{(pid=102148) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:39:16.332993 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-8ca04c24-c65b-498a-9c98-6cf950363055 tempest-TestMinimumBasicScenario-1035681150 tempest-TestMinimumBasicScenario-1035681150-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:39:16.338419 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-8ca04c24-c65b-498a-9c98-6cf950363055 tempest-TestMinimumBasicScenario-1035681150 tempest-TestMinimumBasicScenario-1035681150-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:39:16.339344 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-8ca04c24-c65b-498a-9c98-6cf950363055 tempest-TestMinimumBasicScenario-1035681150 tempest-TestMinimumBasicScenario-1035681150-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:39:16.339784 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-8ca04c24-c65b-498a-9c98-6cf950363055 tempest-TestMinimumBasicScenario-1035681150 tempest-TestMinimumBasicScenario-1035681150-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:39:16.789579 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-8ca04c24-c65b-498a-9c98-6cf950363055 tempest-TestMinimumBasicScenario-1035681150 tempest-TestMinimumBasicScenario-1035681150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f875e9c85597441fb83cb9be8ddf91c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2df211bdae44be6b7e0cc41c2cd11e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:39:16.800425 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-8ca04c24-c65b-498a-9c98-6cf950363055 tempest-TestMinimumBasicScenario-1035681150 tempest-TestMinimumBasicScenario-1035681150-project] 10.222.0.18 "GET /compute/v2.1/servers/121c5ed1-7baf-4e1a-b849-1c17079ff674" status: 200 len: 1358 microversion: 2.1 time: 0.484794 Jun 24 16:39:16.810497 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 367/720] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:39:16 2022] GET /compute/v2.1/servers/121c5ed1-7baf-4e1a-b849-1c17079ff674 => generated 1358 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 16:39:17.102382 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-b4d06859-c1d5-4423-9f69-7b4d13151268 tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] Calling method '>' {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:39:17.103621 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-b4d06859-c1d5-4423-9f69-7b4d13151268 tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] [instance: bd57f4a8-0078-4dde-ac34-901a40bc7b8e] Fetching instance by UUID {{(pid=102149) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:39:17.113168 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-b4d06859-c1d5-4423-9f69-7b4d13151268 tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:39:17.113985 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-b4d06859-c1d5-4423-9f69-7b4d13151268 tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:39:17.114894 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-b4d06859-c1d5-4423-9f69-7b4d13151268 tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:39:17.115575 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-b4d06859-c1d5-4423-9f69-7b4d13151268 tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:39:17.465549 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-b4d06859-c1d5-4423-9f69-7b4d13151268 tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b823267a02a465192aadb5a1c5a3d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34b225f93234ca38c8d0c3d37ba0b8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:39:17.477976 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-b4d06859-c1d5-4423-9f69-7b4d13151268 tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] 10.222.0.18 "GET /compute/v2.1/servers/bd57f4a8-0078-4dde-ac34-901a40bc7b8e" status: 200 len: 1569 microversion: 2.1 time: 0.379164 Jun 24 16:39:17.478611 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 354/721] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:39:17 2022] GET /compute/v2.1/servers/bd57f4a8-0078-4dde-ac34-901a40bc7b8e => generated 1569 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 16:39:17.817319 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-0d3cd4df-74cd-468e-a22f-c2690f9c3d63 tempest-TestMinimumBasicScenario-1035681150 tempest-TestMinimumBasicScenario-1035681150-project] Calling method '>' {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:39:17.818175 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-0d3cd4df-74cd-468e-a22f-c2690f9c3d63 tempest-TestMinimumBasicScenario-1035681150 tempest-TestMinimumBasicScenario-1035681150-project] [instance: 121c5ed1-7baf-4e1a-b849-1c17079ff674] Fetching instance by UUID {{(pid=102148) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:39:17.830084 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-0d3cd4df-74cd-468e-a22f-c2690f9c3d63 tempest-TestMinimumBasicScenario-1035681150 tempest-TestMinimumBasicScenario-1035681150-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:39:17.830980 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-0d3cd4df-74cd-468e-a22f-c2690f9c3d63 tempest-TestMinimumBasicScenario-1035681150 tempest-TestMinimumBasicScenario-1035681150-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:39:17.832166 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-0d3cd4df-74cd-468e-a22f-c2690f9c3d63 tempest-TestMinimumBasicScenario-1035681150 tempest-TestMinimumBasicScenario-1035681150-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:39:17.832845 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-0d3cd4df-74cd-468e-a22f-c2690f9c3d63 tempest-TestMinimumBasicScenario-1035681150 tempest-TestMinimumBasicScenario-1035681150-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:39:18.081316 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-0d3cd4df-74cd-468e-a22f-c2690f9c3d63 tempest-TestMinimumBasicScenario-1035681150 tempest-TestMinimumBasicScenario-1035681150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f875e9c85597441fb83cb9be8ddf91c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2df211bdae44be6b7e0cc41c2cd11e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:39:18.096762 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-0d3cd4df-74cd-468e-a22f-c2690f9c3d63 tempest-TestMinimumBasicScenario-1035681150 tempest-TestMinimumBasicScenario-1035681150-project] 10.222.0.18 "GET /compute/v2.1/servers/121c5ed1-7baf-4e1a-b849-1c17079ff674" status: 200 len: 1358 microversion: 2.1 time: 0.282960 Jun 24 16:39:18.097585 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 368/722] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:39:17 2022] GET /compute/v2.1/servers/121c5ed1-7baf-4e1a-b849-1c17079ff674 => generated 1358 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 16:39:18.501223 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-0395f758-7496-4112-a54a-c67ee6171a0c tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] Calling method '>' {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:39:18.501822 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-0395f758-7496-4112-a54a-c67ee6171a0c tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] [instance: bd57f4a8-0078-4dde-ac34-901a40bc7b8e] Fetching instance by UUID {{(pid=102149) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:39:18.505344 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: ERROR oslo.messaging._drivers.impl_rabbit [-] [673dd0e5-3497-471f-a170-54c432bef5aa] AMQP server on 10.222.0.18:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jun 24 16:39:18.510480 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-0395f758-7496-4112-a54a-c67ee6171a0c tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:39:18.510970 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-0395f758-7496-4112-a54a-c67ee6171a0c tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:39:18.511790 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-0395f758-7496-4112-a54a-c67ee6171a0c tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:39:18.512235 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-0395f758-7496-4112-a54a-c67ee6171a0c tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:39:18.658397 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-91e5c35d-99dc-47b2-9065-f4da75938abe tempest-VolumesNegativeTest-1800250148 tempest-VolumesNegativeTest-1800250148-project] Action: 'create', calling method: .version_select at 0x7f1ae807a430>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-894538821", "metadata": {"Type": "work"}}} {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 16:39:18.659874 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-91e5c35d-99dc-47b2-9065-f4da75938abe tempest-VolumesNegativeTest-1800250148 tempest-VolumesNegativeTest-1800250148-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=102148) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jun 24 16:39:18.660776 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-91e5c35d-99dc-47b2-9065-f4da75938abe tempest-VolumesNegativeTest-1800250148 tempest-VolumesNegativeTest-1800250148-project] 10.222.0.18 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.149635 Jun 24 16:39:18.661389 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 369/723] 10.222.0.18 () {60 vars in 1155 bytes} [Fri Jun 24 16:39:18 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 151 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jun 24 16:39:18.670305 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-67eea371-3d3f-4cd9-9441-95c389217551 tempest-VolumesNegativeTest-1800250148 tempest-VolumesNegativeTest-1800250148-project] Action: 'create', calling method: .version_select at 0x7f1ae840faf0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-374941062", "metadata": {"Type": "work"}}} {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 16:39:18.671631 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-67eea371-3d3f-4cd9-9441-95c389217551 tempest-VolumesNegativeTest-1800250148 tempest-VolumesNegativeTest-1800250148-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=102148) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jun 24 16:39:18.672502 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-67eea371-3d3f-4cd9-9441-95c389217551 tempest-VolumesNegativeTest-1800250148 tempest-VolumesNegativeTest-1800250148-project] 10.222.0.18 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.005897 Jun 24 16:39:18.673644 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 370/724] 10.222.0.18 () {60 vars in 1155 bytes} [Fri Jun 24 16:39:18 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 8 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jun 24 16:39:18.684419 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-2b9bfcb0-3971-4901-8c78-60621ce0c07c tempest-VolumesNegativeTest-1800250148 tempest-VolumesNegativeTest-1800250148-project] Action: 'create', calling method: .version_select at 0x7f1ae8e39c10>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1840332596", "metadata": {"Type": "work"}}} {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 16:39:18.686198 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-2b9bfcb0-3971-4901-8c78-60621ce0c07c tempest-VolumesNegativeTest-1800250148 tempest-VolumesNegativeTest-1800250148-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=102148) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jun 24 16:39:18.687317 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-2b9bfcb0-3971-4901-8c78-60621ce0c07c tempest-VolumesNegativeTest-1800250148 tempest-VolumesNegativeTest-1800250148-project] 10.222.0.18 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.007715 Jun 24 16:39:18.693460 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 371/725] 10.222.0.18 () {60 vars in 1155 bytes} [Fri Jun 24 16:39:18 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 15 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 24 16:39:18.698627 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-417722c7-e5c8-4002-8d22-c034bdd39b37 tempest-VolumesNegativeTest-1800250148 tempest-VolumesNegativeTest-1800250148-project] Calling method '.version_select at 0x7f1ae840f550>' {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:39:18.755296 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-0395f758-7496-4112-a54a-c67ee6171a0c tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b823267a02a465192aadb5a1c5a3d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34b225f93234ca38c8d0c3d37ba0b8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:39:18.764315 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.wsgi [None req-417722c7-e5c8-4002-8d22-c034bdd39b37 tempest-VolumesNegativeTest-1800250148 tempest-VolumesNegativeTest-1800250148-project] HTTP exception thrown: Volume tempest-invalid-1058375036 could not be found. Jun 24 16:39:18.764640 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-0395f758-7496-4112-a54a-c67ee6171a0c tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] 10.222.0.18 "GET /compute/v2.1/servers/bd57f4a8-0078-4dde-ac34-901a40bc7b8e" status: 200 len: 1569 microversion: 2.1 time: 0.267855 Jun 24 16:39:18.764913 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-417722c7-e5c8-4002-8d22-c034bdd39b37 tempest-VolumesNegativeTest-1800250148 tempest-VolumesNegativeTest-1800250148-project] Returning 404 to user: Volume tempest-invalid-1058375036 could not be found. {{(pid=102148) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jun 24 16:39:18.765880 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 355/726] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:39:18 2022] GET /compute/v2.1/servers/bd57f4a8-0078-4dde-ac34-901a40bc7b8e => generated 1569 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 16:39:18.766000 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-417722c7-e5c8-4002-8d22-c034bdd39b37 tempest-VolumesNegativeTest-1800250148 tempest-VolumesNegativeTest-1800250148-project] 10.222.0.18 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1058375036" status: 404 len: 99 microversion: 2.1 time: 0.070927 Jun 24 16:39:18.771319 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 372/727] 10.222.0.18 () {58 vars in 1217 bytes} [Fri Jun 24 16:39:18 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1058375036 => generated 99 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jun 24 16:39:18.776789 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-b44ff67c-8ed6-48d8-8065-32c20815be92 tempest-VolumesNegativeTest-1800250148 tempest-VolumesNegativeTest-1800250148-project] 10.222.0.18 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004095 Jun 24 16:39:18.783073 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 356/728] 10.222.0.18 () {58 vars in 1139 bytes} [Fri Jun 24 16:39:18 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jun 24 16:39:18.788673 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-eecf0401-5864-46a5-ac85-02a1077b4896 tempest-VolumesNegativeTest-1800250148 tempest-VolumesNegativeTest-1800250148-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004380 Jun 24 16:39:18.790334 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 373/729] 10.222.0.18 () {58 vars in 1136 bytes} [Fri Jun 24 16:39:18 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Jun 24 16:39:18.800713 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-e43362b1-3139-4104-8e2b-7772553caa8e tempest-VolumesNegativeTest-1800250148 tempest-VolumesNegativeTest-1800250148-project] Calling method '.version_select at 0x7f1ae84dedc0>' {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:39:18.870588 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.wsgi [None req-e43362b1-3139-4104-8e2b-7772553caa8e tempest-VolumesNegativeTest-1800250148 tempest-VolumesNegativeTest-1800250148-project] HTTP exception thrown: Volume 1a77f914-86d1-4563-9698-c81d6bb458f3 could not be found. Jun 24 16:39:18.871400 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-e43362b1-3139-4104-8e2b-7772553caa8e tempest-VolumesNegativeTest-1800250148 tempest-VolumesNegativeTest-1800250148-project] Returning 404 to user: Volume 1a77f914-86d1-4563-9698-c81d6bb458f3 could not be found. {{(pid=102149) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jun 24 16:39:18.872547 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-e43362b1-3139-4104-8e2b-7772553caa8e tempest-VolumesNegativeTest-1800250148 tempest-VolumesNegativeTest-1800250148-project] 10.222.0.18 "DELETE /compute/v2.1/os-volumes/1a77f914-86d1-4563-9698-c81d6bb458f3" status: 404 len: 109 microversion: 2.1 time: 0.075922 Jun 24 16:39:18.878740 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 357/730] 10.222.0.18 () {58 vars in 1247 bytes} [Fri Jun 24 16:39:18 2022] DELETE /compute/v2.1/os-volumes/1a77f914-86d1-4563-9698-c81d6bb458f3 => generated 109 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 16:39:18.884351 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-c96db1b1-13fb-487e-8aaa-3a4efb6d0454 tempest-VolumesNegativeTest-1800250148 tempest-VolumesNegativeTest-1800250148-project] Calling method '.version_select at 0x7f1ae807a0d0>' {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:39:18.945835 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.wsgi [None req-c96db1b1-13fb-487e-8aaa-3a4efb6d0454 tempest-VolumesNegativeTest-1800250148 tempest-VolumesNegativeTest-1800250148-project] HTTP exception thrown: Volume cd9dda51-10f6-4888-8fdc-9fc781a402cc could not be found. Jun 24 16:39:18.946506 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-c96db1b1-13fb-487e-8aaa-3a4efb6d0454 tempest-VolumesNegativeTest-1800250148 tempest-VolumesNegativeTest-1800250148-project] Returning 404 to user: Volume cd9dda51-10f6-4888-8fdc-9fc781a402cc could not be found. {{(pid=102148) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jun 24 16:39:18.947378 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-c96db1b1-13fb-487e-8aaa-3a4efb6d0454 tempest-VolumesNegativeTest-1800250148 tempest-VolumesNegativeTest-1800250148-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/cd9dda51-10f6-4888-8fdc-9fc781a402cc" status: 404 len: 109 microversion: 2.1 time: 0.067184 Jun 24 16:39:18.948047 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 374/731] 10.222.0.18 () {58 vars in 1244 bytes} [Fri Jun 24 16:39:18 2022] GET /compute/v2.1/os-volumes/cd9dda51-10f6-4888-8fdc-9fc781a402cc => generated 109 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 16:39:19.115545 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-a6de3285-eb7b-4364-be22-e1897b39836a tempest-TestMinimumBasicScenario-1035681150 tempest-TestMinimumBasicScenario-1035681150-project] Calling method '>' {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:39:19.116319 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-a6de3285-eb7b-4364-be22-e1897b39836a tempest-TestMinimumBasicScenario-1035681150 tempest-TestMinimumBasicScenario-1035681150-project] [instance: 121c5ed1-7baf-4e1a-b849-1c17079ff674] Fetching instance by UUID {{(pid=102149) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:39:19.124957 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-a6de3285-eb7b-4364-be22-e1897b39836a tempest-TestMinimumBasicScenario-1035681150 tempest-TestMinimumBasicScenario-1035681150-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:39:19.125425 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-a6de3285-eb7b-4364-be22-e1897b39836a tempest-TestMinimumBasicScenario-1035681150 tempest-TestMinimumBasicScenario-1035681150-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:39:19.126992 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-a6de3285-eb7b-4364-be22-e1897b39836a tempest-TestMinimumBasicScenario-1035681150 tempest-TestMinimumBasicScenario-1035681150-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:39:19.127422 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-a6de3285-eb7b-4364-be22-e1897b39836a tempest-TestMinimumBasicScenario-1035681150 tempest-TestMinimumBasicScenario-1035681150-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:39:19.441299 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-a6de3285-eb7b-4364-be22-e1897b39836a tempest-TestMinimumBasicScenario-1035681150 tempest-TestMinimumBasicScenario-1035681150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f875e9c85597441fb83cb9be8ddf91c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2df211bdae44be6b7e0cc41c2cd11e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:39:19.450182 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-a6de3285-eb7b-4364-be22-e1897b39836a tempest-TestMinimumBasicScenario-1035681150 tempest-TestMinimumBasicScenario-1035681150-project] 10.222.0.18 "GET /compute/v2.1/servers/121c5ed1-7baf-4e1a-b849-1c17079ff674" status: 200 len: 1358 microversion: 2.1 time: 0.338183 Jun 24 16:39:19.451491 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 358/732] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:39:19 2022] GET /compute/v2.1/servers/121c5ed1-7baf-4e1a-b849-1c17079ff674 => generated 1358 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 16:39:19.784442 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-3df286e2-2af8-4bf8-8cea-e3459f47e345 tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] Calling method '>' {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:39:19.785080 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-3df286e2-2af8-4bf8-8cea-e3459f47e345 tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] [instance: bd57f4a8-0078-4dde-ac34-901a40bc7b8e] Fetching instance by UUID {{(pid=102148) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:39:19.802881 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-3df286e2-2af8-4bf8-8cea-e3459f47e345 tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:39:19.803886 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-3df286e2-2af8-4bf8-8cea-e3459f47e345 tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:39:19.809933 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-3df286e2-2af8-4bf8-8cea-e3459f47e345 tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:39:19.810934 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-3df286e2-2af8-4bf8-8cea-e3459f47e345 tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:39:20.109522 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-3df286e2-2af8-4bf8-8cea-e3459f47e345 tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b823267a02a465192aadb5a1c5a3d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34b225f93234ca38c8d0c3d37ba0b8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:39:20.117978 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-3df286e2-2af8-4bf8-8cea-e3459f47e345 tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] 10.222.0.18 "GET /compute/v2.1/servers/bd57f4a8-0078-4dde-ac34-901a40bc7b8e" status: 200 len: 1569 microversion: 2.1 time: 0.338613 Jun 24 16:39:20.118794 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 375/733] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:39:19 2022] GET /compute/v2.1/servers/bd57f4a8-0078-4dde-ac34-901a40bc7b8e => generated 1569 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 16:39:20.471790 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-9562e5de-cd43-4d59-b8db-eb0ac7741cac tempest-TestMinimumBasicScenario-1035681150 tempest-TestMinimumBasicScenario-1035681150-project] Calling method '>' {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:39:20.473070 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-9562e5de-cd43-4d59-b8db-eb0ac7741cac tempest-TestMinimumBasicScenario-1035681150 tempest-TestMinimumBasicScenario-1035681150-project] [instance: 121c5ed1-7baf-4e1a-b849-1c17079ff674] Fetching instance by UUID {{(pid=102149) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:39:20.490509 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-9562e5de-cd43-4d59-b8db-eb0ac7741cac tempest-TestMinimumBasicScenario-1035681150 tempest-TestMinimumBasicScenario-1035681150-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:39:20.490782 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-9562e5de-cd43-4d59-b8db-eb0ac7741cac tempest-TestMinimumBasicScenario-1035681150 tempest-TestMinimumBasicScenario-1035681150-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:39:20.491612 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-9562e5de-cd43-4d59-b8db-eb0ac7741cac tempest-TestMinimumBasicScenario-1035681150 tempest-TestMinimumBasicScenario-1035681150-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:39:20.492118 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-9562e5de-cd43-4d59-b8db-eb0ac7741cac tempest-TestMinimumBasicScenario-1035681150 tempest-TestMinimumBasicScenario-1035681150-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:39:20.529448 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO oslo.messaging._drivers.impl_rabbit [-] [673dd0e5-3497-471f-a170-54c432bef5aa] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 57168. Jun 24 16:39:20.749009 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-9562e5de-cd43-4d59-b8db-eb0ac7741cac tempest-TestMinimumBasicScenario-1035681150 tempest-TestMinimumBasicScenario-1035681150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f875e9c85597441fb83cb9be8ddf91c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2df211bdae44be6b7e0cc41c2cd11e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:39:20.757739 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-9562e5de-cd43-4d59-b8db-eb0ac7741cac tempest-TestMinimumBasicScenario-1035681150 tempest-TestMinimumBasicScenario-1035681150-project] 10.222.0.18 "GET /compute/v2.1/servers/121c5ed1-7baf-4e1a-b849-1c17079ff674" status: 200 len: 1358 microversion: 2.1 time: 0.292510 Jun 24 16:39:20.758325 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 359/734] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:39:20 2022] GET /compute/v2.1/servers/121c5ed1-7baf-4e1a-b849-1c17079ff674 => generated 1358 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 16:39:21.136868 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-302bef29-786c-4f29-bc74-d130e9abdacb tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] Calling method '>' {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:39:21.137895 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-302bef29-786c-4f29-bc74-d130e9abdacb tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] [instance: bd57f4a8-0078-4dde-ac34-901a40bc7b8e] Fetching instance by UUID {{(pid=102148) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:39:21.146722 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-302bef29-786c-4f29-bc74-d130e9abdacb tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:39:21.147445 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-302bef29-786c-4f29-bc74-d130e9abdacb tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:39:21.148695 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-302bef29-786c-4f29-bc74-d130e9abdacb tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:39:21.149393 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-302bef29-786c-4f29-bc74-d130e9abdacb tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:39:21.413678 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-302bef29-786c-4f29-bc74-d130e9abdacb tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b823267a02a465192aadb5a1c5a3d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34b225f93234ca38c8d0c3d37ba0b8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:39:21.427250 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-302bef29-786c-4f29-bc74-d130e9abdacb tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] 10.222.0.18 "GET /compute/v2.1/servers/bd57f4a8-0078-4dde-ac34-901a40bc7b8e" status: 200 len: 1569 microversion: 2.1 time: 0.294606 Jun 24 16:39:21.428226 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 376/735] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:39:21 2022] GET /compute/v2.1/servers/bd57f4a8-0078-4dde-ac34-901a40bc7b8e => generated 1569 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 16:39:21.776057 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-32656328-40f4-4237-b0d9-897f694a02f7 tempest-TestMinimumBasicScenario-1035681150 tempest-TestMinimumBasicScenario-1035681150-project] Calling method '>' {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:39:21.777053 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-32656328-40f4-4237-b0d9-897f694a02f7 tempest-TestMinimumBasicScenario-1035681150 tempest-TestMinimumBasicScenario-1035681150-project] [instance: 121c5ed1-7baf-4e1a-b849-1c17079ff674] Fetching instance by UUID {{(pid=102149) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:39:21.784495 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-32656328-40f4-4237-b0d9-897f694a02f7 tempest-TestMinimumBasicScenario-1035681150 tempest-TestMinimumBasicScenario-1035681150-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:39:21.784942 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-32656328-40f4-4237-b0d9-897f694a02f7 tempest-TestMinimumBasicScenario-1035681150 tempest-TestMinimumBasicScenario-1035681150-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:39:21.785857 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-32656328-40f4-4237-b0d9-897f694a02f7 tempest-TestMinimumBasicScenario-1035681150 tempest-TestMinimumBasicScenario-1035681150-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:39:21.786256 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-32656328-40f4-4237-b0d9-897f694a02f7 tempest-TestMinimumBasicScenario-1035681150 tempest-TestMinimumBasicScenario-1035681150-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:39:22.037807 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-32656328-40f4-4237-b0d9-897f694a02f7 tempest-TestMinimumBasicScenario-1035681150 tempest-TestMinimumBasicScenario-1035681150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f875e9c85597441fb83cb9be8ddf91c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2df211bdae44be6b7e0cc41c2cd11e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:39:22.048482 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-32656328-40f4-4237-b0d9-897f694a02f7 tempest-TestMinimumBasicScenario-1035681150 tempest-TestMinimumBasicScenario-1035681150-project] 10.222.0.18 "GET /compute/v2.1/servers/121c5ed1-7baf-4e1a-b849-1c17079ff674" status: 200 len: 1358 microversion: 2.1 time: 0.276421 Jun 24 16:39:22.049109 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 360/736] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:39:21 2022] GET /compute/v2.1/servers/121c5ed1-7baf-4e1a-b849-1c17079ff674 => generated 1358 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 16:39:22.093264 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [req-c20cf74a-ec5c-42c5-9c8b-0f4c86442dc0 req-bc1cbee7-517e-4751-81f7-75aec235b6f4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "121c5ed1-7baf-4e1a-b849-1c17079ff674", "name": "network-vif-plugged", "status": "completed", "tag": "688e29ea-2634-442c-8941-c7390b7f3cc6"}]} {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 16:39:22.095409 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 24 16:39:22.095409 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: warnings.warn(msg) Jun 24 16:39:22.107715 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [req-c20cf74a-ec5c-42c5-9c8b-0f4c86442dc0 req-bc1cbee7-517e-4751-81f7-75aec235b6f4 service nova] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:39:22.108160 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [req-c20cf74a-ec5c-42c5-9c8b-0f4c86442dc0 req-bc1cbee7-517e-4751-81f7-75aec235b6f4 service nova] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:39:22.133045 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.compute.server_external_events [req-c20cf74a-ec5c-42c5-9c8b-0f4c86442dc0 req-bc1cbee7-517e-4751-81f7-75aec235b6f4 service nova] Creating event network-vif-plugged:688e29ea-2634-442c-8941-c7390b7f3cc6 for instance 121c5ed1-7baf-4e1a-b849-1c17079ff674 on hv-cinder-84718 Jun 24 16:39:22.141108 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [req-c20cf74a-ec5c-42c5-9c8b-0f4c86442dc0 req-bc1cbee7-517e-4751-81f7-75aec235b6f4 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049586 Jun 24 16:39:22.142256 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 377/737] 10.222.0.18 () {64 vars in 1317 bytes} [Fri Jun 24 16:39:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 16:39:22.451840 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-cb2b86a6-312b-406f-a7a0-5b23c5c2c046 tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] Calling method '>' {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:39:22.452940 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-cb2b86a6-312b-406f-a7a0-5b23c5c2c046 tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] [instance: bd57f4a8-0078-4dde-ac34-901a40bc7b8e] Fetching instance by UUID {{(pid=102149) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:39:22.465538 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-cb2b86a6-312b-406f-a7a0-5b23c5c2c046 tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:39:22.465967 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-cb2b86a6-312b-406f-a7a0-5b23c5c2c046 tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:39:22.466791 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-cb2b86a6-312b-406f-a7a0-5b23c5c2c046 tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:39:22.467223 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-cb2b86a6-312b-406f-a7a0-5b23c5c2c046 tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:39:22.726912 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-cb2b86a6-312b-406f-a7a0-5b23c5c2c046 tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b823267a02a465192aadb5a1c5a3d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34b225f93234ca38c8d0c3d37ba0b8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:39:22.739254 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-cb2b86a6-312b-406f-a7a0-5b23c5c2c046 tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] 10.222.0.18 "GET /compute/v2.1/servers/bd57f4a8-0078-4dde-ac34-901a40bc7b8e" status: 200 len: 1569 microversion: 2.1 time: 0.293737 Jun 24 16:39:22.739743 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 361/738] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:39:22 2022] GET /compute/v2.1/servers/bd57f4a8-0078-4dde-ac34-901a40bc7b8e => generated 1569 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 16:39:23.071055 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-eedaf24d-3152-4e87-aca9-87a2560e72ef tempest-TestMinimumBasicScenario-1035681150 tempest-TestMinimumBasicScenario-1035681150-project] Calling method '>' {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:39:23.071754 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-eedaf24d-3152-4e87-aca9-87a2560e72ef tempest-TestMinimumBasicScenario-1035681150 tempest-TestMinimumBasicScenario-1035681150-project] [instance: 121c5ed1-7baf-4e1a-b849-1c17079ff674] Fetching instance by UUID {{(pid=102148) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:39:23.082901 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-eedaf24d-3152-4e87-aca9-87a2560e72ef tempest-TestMinimumBasicScenario-1035681150 tempest-TestMinimumBasicScenario-1035681150-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:39:23.083353 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-eedaf24d-3152-4e87-aca9-87a2560e72ef tempest-TestMinimumBasicScenario-1035681150 tempest-TestMinimumBasicScenario-1035681150-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:39:23.084154 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-eedaf24d-3152-4e87-aca9-87a2560e72ef tempest-TestMinimumBasicScenario-1035681150 tempest-TestMinimumBasicScenario-1035681150-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:39:23.084624 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-eedaf24d-3152-4e87-aca9-87a2560e72ef tempest-TestMinimumBasicScenario-1035681150 tempest-TestMinimumBasicScenario-1035681150-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:39:23.416556 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-eedaf24d-3152-4e87-aca9-87a2560e72ef tempest-TestMinimumBasicScenario-1035681150 tempest-TestMinimumBasicScenario-1035681150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f875e9c85597441fb83cb9be8ddf91c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2df211bdae44be6b7e0cc41c2cd11e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:39:23.434426 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-eedaf24d-3152-4e87-aca9-87a2560e72ef tempest-TestMinimumBasicScenario-1035681150 tempest-TestMinimumBasicScenario-1035681150-project] 10.222.0.18 "GET /compute/v2.1/servers/121c5ed1-7baf-4e1a-b849-1c17079ff674" status: 200 len: 1358 microversion: 2.1 time: 0.364428 Jun 24 16:39:23.435085 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 378/739] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:39:23 2022] GET /compute/v2.1/servers/121c5ed1-7baf-4e1a-b849-1c17079ff674 => generated 1358 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 16:39:23.756916 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-e7b0e198-ba9a-4843-9734-f8b26a6ad0c3 tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] Calling method '>' {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:39:23.757513 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-e7b0e198-ba9a-4843-9734-f8b26a6ad0c3 tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] [instance: bd57f4a8-0078-4dde-ac34-901a40bc7b8e] Fetching instance by UUID {{(pid=102149) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:39:23.765336 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-e7b0e198-ba9a-4843-9734-f8b26a6ad0c3 tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:39:23.765752 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-e7b0e198-ba9a-4843-9734-f8b26a6ad0c3 tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:39:23.767344 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-e7b0e198-ba9a-4843-9734-f8b26a6ad0c3 tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:39:23.767344 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-e7b0e198-ba9a-4843-9734-f8b26a6ad0c3 tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:39:24.024980 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-e7b0e198-ba9a-4843-9734-f8b26a6ad0c3 tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b823267a02a465192aadb5a1c5a3d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34b225f93234ca38c8d0c3d37ba0b8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:39:24.036253 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-e7b0e198-ba9a-4843-9734-f8b26a6ad0c3 tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] 10.222.0.18 "GET /compute/v2.1/servers/bd57f4a8-0078-4dde-ac34-901a40bc7b8e" status: 200 len: 1569 microversion: 2.1 time: 0.283566 Jun 24 16:39:24.036839 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 362/740] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:39:23 2022] GET /compute/v2.1/servers/bd57f4a8-0078-4dde-ac34-901a40bc7b8e => generated 1569 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 16:39:24.456232 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-c4d2740a-1642-4ab5-9e82-d667f4139575 tempest-TestMinimumBasicScenario-1035681150 tempest-TestMinimumBasicScenario-1035681150-project] Calling method '>' {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:39:24.457273 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-c4d2740a-1642-4ab5-9e82-d667f4139575 tempest-TestMinimumBasicScenario-1035681150 tempest-TestMinimumBasicScenario-1035681150-project] [instance: 121c5ed1-7baf-4e1a-b849-1c17079ff674] Fetching instance by UUID {{(pid=102148) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:39:24.466005 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-c4d2740a-1642-4ab5-9e82-d667f4139575 tempest-TestMinimumBasicScenario-1035681150 tempest-TestMinimumBasicScenario-1035681150-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:39:24.466444 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-c4d2740a-1642-4ab5-9e82-d667f4139575 tempest-TestMinimumBasicScenario-1035681150 tempest-TestMinimumBasicScenario-1035681150-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:39:24.467243 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-c4d2740a-1642-4ab5-9e82-d667f4139575 tempest-TestMinimumBasicScenario-1035681150 tempest-TestMinimumBasicScenario-1035681150-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:39:24.467679 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-c4d2740a-1642-4ab5-9e82-d667f4139575 tempest-TestMinimumBasicScenario-1035681150 tempest-TestMinimumBasicScenario-1035681150-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:39:24.712246 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-c4d2740a-1642-4ab5-9e82-d667f4139575 tempest-TestMinimumBasicScenario-1035681150 tempest-TestMinimumBasicScenario-1035681150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f875e9c85597441fb83cb9be8ddf91c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2df211bdae44be6b7e0cc41c2cd11e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:39:24.728496 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-c4d2740a-1642-4ab5-9e82-d667f4139575 tempest-TestMinimumBasicScenario-1035681150 tempest-TestMinimumBasicScenario-1035681150-project] 10.222.0.18 "GET /compute/v2.1/servers/121c5ed1-7baf-4e1a-b849-1c17079ff674" status: 200 len: 1548 microversion: 2.1 time: 0.277984 Jun 24 16:39:24.729657 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 379/741] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:39:24 2022] GET /compute/v2.1/servers/121c5ed1-7baf-4e1a-b849-1c17079ff674 => generated 1548 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 16:39:24.745944 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-d72fc4ed-8f01-4e82-893d-47160a1a10ac tempest-TestMinimumBasicScenario-1035681150 tempest-TestMinimumBasicScenario-1035681150-project] Calling method '>' {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:39:24.746561 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-d72fc4ed-8f01-4e82-893d-47160a1a10ac tempest-TestMinimumBasicScenario-1035681150 tempest-TestMinimumBasicScenario-1035681150-project] [instance: 121c5ed1-7baf-4e1a-b849-1c17079ff674] Fetching instance by UUID {{(pid=102149) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:39:24.754888 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-d72fc4ed-8f01-4e82-893d-47160a1a10ac tempest-TestMinimumBasicScenario-1035681150 tempest-TestMinimumBasicScenario-1035681150-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:39:24.755330 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-d72fc4ed-8f01-4e82-893d-47160a1a10ac tempest-TestMinimumBasicScenario-1035681150 tempest-TestMinimumBasicScenario-1035681150-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:39:24.756130 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-d72fc4ed-8f01-4e82-893d-47160a1a10ac tempest-TestMinimumBasicScenario-1035681150 tempest-TestMinimumBasicScenario-1035681150-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:39:24.756559 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-d72fc4ed-8f01-4e82-893d-47160a1a10ac tempest-TestMinimumBasicScenario-1035681150 tempest-TestMinimumBasicScenario-1035681150-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:39:24.996882 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-d72fc4ed-8f01-4e82-893d-47160a1a10ac tempest-TestMinimumBasicScenario-1035681150 tempest-TestMinimumBasicScenario-1035681150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f875e9c85597441fb83cb9be8ddf91c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2df211bdae44be6b7e0cc41c2cd11e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:39:25.008092 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-d72fc4ed-8f01-4e82-893d-47160a1a10ac tempest-TestMinimumBasicScenario-1035681150 tempest-TestMinimumBasicScenario-1035681150-project] 10.222.0.18 "GET /compute/v2.1/servers/121c5ed1-7baf-4e1a-b849-1c17079ff674" status: 200 len: 1548 microversion: 2.1 time: 0.265856 Jun 24 16:39:25.008744 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 363/742] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:39:24 2022] GET /compute/v2.1/servers/121c5ed1-7baf-4e1a-b849-1c17079ff674 => generated 1548 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 16:39:25.025035 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-f7b42e4c-3464-4299-bd2b-3ca0740605b9 tempest-TestMinimumBasicScenario-1035681150 tempest-TestMinimumBasicScenario-1035681150-project] Calling method '>' {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:39:25.029359 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:servers:allow_all_filters failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 24 16:39:25.029359 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: warnings.warn(msg) Jun 24 16:39:25.031072 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-f7b42e4c-3464-4299-bd2b-3ca0740605b9 tempest-TestMinimumBasicScenario-1035681150 tempest-TestMinimumBasicScenario-1035681150-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f875e9c85597441fb83cb9be8ddf91c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2df211bdae44be6b7e0cc41c2cd11e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:39:25.032479 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-f7b42e4c-3464-4299-bd2b-3ca0740605b9 tempest-TestMinimumBasicScenario-1035681150 tempest-TestMinimumBasicScenario-1035681150-project] Searching by: {'deleted': False, 'project_id': 'e2df211bdae44be6b7e0cc41c2cd11e4'} {{(pid=102148) get_all /opt/stack/nova/nova/compute/api.py:2855}} Jun 24 16:39:25.039732 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-f7b42e4c-3464-4299-bd2b-3ca0740605b9 tempest-TestMinimumBasicScenario-1035681150 tempest-TestMinimumBasicScenario-1035681150-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:39:25.040176 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-f7b42e4c-3464-4299-bd2b-3ca0740605b9 tempest-TestMinimumBasicScenario-1035681150 tempest-TestMinimumBasicScenario-1035681150-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:39:25.040991 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-f7b42e4c-3464-4299-bd2b-3ca0740605b9 tempest-TestMinimumBasicScenario-1035681150 tempest-TestMinimumBasicScenario-1035681150-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:39:25.041429 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-f7b42e4c-3464-4299-bd2b-3ca0740605b9 tempest-TestMinimumBasicScenario-1035681150 tempest-TestMinimumBasicScenario-1035681150-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:39:25.056789 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-5d191e6b-839b-4a93-aba6-c220394f08ea tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] Calling method '>' {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:39:25.057824 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-5d191e6b-839b-4a93-aba6-c220394f08ea tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] [instance: bd57f4a8-0078-4dde-ac34-901a40bc7b8e] Fetching instance by UUID {{(pid=102149) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:39:25.066910 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-5d191e6b-839b-4a93-aba6-c220394f08ea tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:39:25.067360 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-5d191e6b-839b-4a93-aba6-c220394f08ea tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:39:25.068143 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-5d191e6b-839b-4a93-aba6-c220394f08ea tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:39:25.068569 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-5d191e6b-839b-4a93-aba6-c220394f08ea tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:39:25.150082 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.multi_cell_list [None req-f7b42e4c-3464-4299-bd2b-3ca0740605b9 tempest-TestMinimumBasicScenario-1035681150 tempest-TestMinimumBasicScenario-1035681150-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=102148) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:371}} Jun 24 16:39:25.277159 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-f7b42e4c-3464-4299-bd2b-3ca0740605b9 tempest-TestMinimumBasicScenario-1035681150 tempest-TestMinimumBasicScenario-1035681150-project] 10.222.0.18 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.256938 Jun 24 16:39:25.277740 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 380/743] 10.222.0.18 () {58 vars in 1124 bytes} [Fri Jun 24 16:39:25 2022] GET /compute/v2.1/servers => generated 342 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 16:39:25.288455 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-45e89012-d4d3-4c15-8c7f-66a8186e35a1 tempest-TestMinimumBasicScenario-1035681150 tempest-TestMinimumBasicScenario-1035681150-project] Calling method '>' {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:39:25.289069 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-45e89012-d4d3-4c15-8c7f-66a8186e35a1 tempest-TestMinimumBasicScenario-1035681150 tempest-TestMinimumBasicScenario-1035681150-project] [instance: 121c5ed1-7baf-4e1a-b849-1c17079ff674] Fetching instance by UUID {{(pid=102148) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:39:25.302772 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-45e89012-d4d3-4c15-8c7f-66a8186e35a1 tempest-TestMinimumBasicScenario-1035681150 tempest-TestMinimumBasicScenario-1035681150-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:39:25.303661 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-45e89012-d4d3-4c15-8c7f-66a8186e35a1 tempest-TestMinimumBasicScenario-1035681150 tempest-TestMinimumBasicScenario-1035681150-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:39:25.304693 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-45e89012-d4d3-4c15-8c7f-66a8186e35a1 tempest-TestMinimumBasicScenario-1035681150 tempest-TestMinimumBasicScenario-1035681150-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:39:25.305347 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-45e89012-d4d3-4c15-8c7f-66a8186e35a1 tempest-TestMinimumBasicScenario-1035681150 tempest-TestMinimumBasicScenario-1035681150-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:39:25.381912 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-5d191e6b-839b-4a93-aba6-c220394f08ea tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b823267a02a465192aadb5a1c5a3d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34b225f93234ca38c8d0c3d37ba0b8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:39:25.404068 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-5d191e6b-839b-4a93-aba6-c220394f08ea tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] 10.222.0.18 "GET /compute/v2.1/servers/bd57f4a8-0078-4dde-ac34-901a40bc7b8e" status: 200 len: 1569 microversion: 2.1 time: 0.352692 Jun 24 16:39:25.406012 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 364/744] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:39:25 2022] GET /compute/v2.1/servers/bd57f4a8-0078-4dde-ac34-901a40bc7b8e => generated 1569 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 16:39:25.603083 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-45e89012-d4d3-4c15-8c7f-66a8186e35a1 tempest-TestMinimumBasicScenario-1035681150 tempest-TestMinimumBasicScenario-1035681150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f875e9c85597441fb83cb9be8ddf91c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2df211bdae44be6b7e0cc41c2cd11e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:39:25.612731 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-45e89012-d4d3-4c15-8c7f-66a8186e35a1 tempest-TestMinimumBasicScenario-1035681150 tempest-TestMinimumBasicScenario-1035681150-project] 10.222.0.18 "GET /compute/v2.1/servers/121c5ed1-7baf-4e1a-b849-1c17079ff674" status: 200 len: 1548 microversion: 2.1 time: 0.327881 Jun 24 16:39:25.613340 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 381/745] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:39:25 2022] GET /compute/v2.1/servers/121c5ed1-7baf-4e1a-b849-1c17079ff674 => generated 1548 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 16:39:26.427681 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-1d7932f8-5877-40e0-9f81-b6df9e71c0e1 tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] Calling method '>' {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:39:26.429568 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-1d7932f8-5877-40e0-9f81-b6df9e71c0e1 tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] [instance: bd57f4a8-0078-4dde-ac34-901a40bc7b8e] Fetching instance by UUID {{(pid=102149) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:39:26.443560 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-1d7932f8-5877-40e0-9f81-b6df9e71c0e1 tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:39:26.444572 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-1d7932f8-5877-40e0-9f81-b6df9e71c0e1 tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:39:26.445543 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-1d7932f8-5877-40e0-9f81-b6df9e71c0e1 tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:39:26.445984 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-1d7932f8-5877-40e0-9f81-b6df9e71c0e1 tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:39:26.679846 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-1d7932f8-5877-40e0-9f81-b6df9e71c0e1 tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b823267a02a465192aadb5a1c5a3d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34b225f93234ca38c8d0c3d37ba0b8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:39:26.687779 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-1d7932f8-5877-40e0-9f81-b6df9e71c0e1 tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] 10.222.0.18 "GET /compute/v2.1/servers/bd57f4a8-0078-4dde-ac34-901a40bc7b8e" status: 200 len: 1569 microversion: 2.1 time: 0.264066 Jun 24 16:39:26.688336 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 365/746] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:39:26 2022] GET /compute/v2.1/servers/bd57f4a8-0078-4dde-ac34-901a40bc7b8e => generated 1569 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 16:39:27.479510 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-ea4515a9-004e-47d1-b372-318423cb9129 tempest-TestMinimumBasicScenario-1035681150 tempest-TestMinimumBasicScenario-1035681150-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2b84aa23-9e31-4a4d-8c94-2471f5dd29fd"}} {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 16:39:27.480654 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-ea4515a9-004e-47d1-b372-318423cb9129 tempest-TestMinimumBasicScenario-1035681150 tempest-TestMinimumBasicScenario-1035681150-project] [instance: 121c5ed1-7baf-4e1a-b849-1c17079ff674] Fetching instance by UUID {{(pid=102148) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:39:27.487859 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-ea4515a9-004e-47d1-b372-318423cb9129 tempest-TestMinimumBasicScenario-1035681150 tempest-TestMinimumBasicScenario-1035681150-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:39:27.488300 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-ea4515a9-004e-47d1-b372-318423cb9129 tempest-TestMinimumBasicScenario-1035681150 tempest-TestMinimumBasicScenario-1035681150-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:39:27.489053 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-ea4515a9-004e-47d1-b372-318423cb9129 tempest-TestMinimumBasicScenario-1035681150 tempest-TestMinimumBasicScenario-1035681150-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:39:27.489475 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-ea4515a9-004e-47d1-b372-318423cb9129 tempest-TestMinimumBasicScenario-1035681150 tempest-TestMinimumBasicScenario-1035681150-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:39:27.704239 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-bf3d402f-3d63-4336-a44f-70b28628825c tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] Calling method '>' {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:39:27.705001 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-bf3d402f-3d63-4336-a44f-70b28628825c tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] [instance: bd57f4a8-0078-4dde-ac34-901a40bc7b8e] Fetching instance by UUID {{(pid=102149) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:39:27.711892 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-bf3d402f-3d63-4336-a44f-70b28628825c tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:39:27.712342 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-bf3d402f-3d63-4336-a44f-70b28628825c tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:39:27.713106 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-bf3d402f-3d63-4336-a44f-70b28628825c tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:39:27.713541 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-bf3d402f-3d63-4336-a44f-70b28628825c tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:39:27.867441 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-ea4515a9-004e-47d1-b372-318423cb9129 tempest-TestMinimumBasicScenario-1035681150 tempest-TestMinimumBasicScenario-1035681150-project] 10.222.0.18 "POST /compute/v2.1/servers/121c5ed1-7baf-4e1a-b849-1c17079ff674/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.391293 Jun 24 16:39:27.868543 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 382/747] 10.222.0.18 () {60 vars in 1322 bytes} [Fri Jun 24 16:39:27 2022] POST /compute/v2.1/servers/121c5ed1-7baf-4e1a-b849-1c17079ff674/os-volume_attachments => generated 194 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 16:39:27.940240 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-bf3d402f-3d63-4336-a44f-70b28628825c tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b823267a02a465192aadb5a1c5a3d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34b225f93234ca38c8d0c3d37ba0b8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:39:27.956062 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-bf3d402f-3d63-4336-a44f-70b28628825c tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] 10.222.0.18 "GET /compute/v2.1/servers/bd57f4a8-0078-4dde-ac34-901a40bc7b8e" status: 200 len: 1569 microversion: 2.1 time: 0.253099 Jun 24 16:39:27.956062 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 366/748] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:39:27 2022] GET /compute/v2.1/servers/bd57f4a8-0078-4dde-ac34-901a40bc7b8e => generated 1569 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 16:39:28.973082 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-2fecb6d4-03ce-486f-abaa-a2415b174b5f tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] Calling method '>' {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:39:28.973774 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-2fecb6d4-03ce-486f-abaa-a2415b174b5f tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] [instance: bd57f4a8-0078-4dde-ac34-901a40bc7b8e] Fetching instance by UUID {{(pid=102148) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:39:28.982568 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-2fecb6d4-03ce-486f-abaa-a2415b174b5f tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:39:28.983034 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-2fecb6d4-03ce-486f-abaa-a2415b174b5f tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:39:28.983799 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-2fecb6d4-03ce-486f-abaa-a2415b174b5f tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:39:28.984364 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-2fecb6d4-03ce-486f-abaa-a2415b174b5f tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:39:29.288700 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-2fecb6d4-03ce-486f-abaa-a2415b174b5f tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b823267a02a465192aadb5a1c5a3d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34b225f93234ca38c8d0c3d37ba0b8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:39:29.296918 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-2fecb6d4-03ce-486f-abaa-a2415b174b5f tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] 10.222.0.18 "GET /compute/v2.1/servers/bd57f4a8-0078-4dde-ac34-901a40bc7b8e" status: 200 len: 1569 microversion: 2.1 time: 0.328812 Jun 24 16:39:29.297540 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 383/749] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:39:28 2022] GET /compute/v2.1/servers/bd57f4a8-0078-4dde-ac34-901a40bc7b8e => generated 1569 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 16:39:30.314549 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-37d880c0-a09c-44af-97eb-a44fe4726886 tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] Calling method '>' {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:39:30.315091 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-37d880c0-a09c-44af-97eb-a44fe4726886 tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] [instance: bd57f4a8-0078-4dde-ac34-901a40bc7b8e] Fetching instance by UUID {{(pid=102149) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:39:30.322508 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-37d880c0-a09c-44af-97eb-a44fe4726886 tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:39:30.322988 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-37d880c0-a09c-44af-97eb-a44fe4726886 tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:39:30.323788 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-37d880c0-a09c-44af-97eb-a44fe4726886 tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:39:30.324218 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-37d880c0-a09c-44af-97eb-a44fe4726886 tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:39:30.540500 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-37d880c0-a09c-44af-97eb-a44fe4726886 tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b823267a02a465192aadb5a1c5a3d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34b225f93234ca38c8d0c3d37ba0b8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:39:30.549300 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-37d880c0-a09c-44af-97eb-a44fe4726886 tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] 10.222.0.18 "GET /compute/v2.1/servers/bd57f4a8-0078-4dde-ac34-901a40bc7b8e" status: 200 len: 1510 microversion: 2.1 time: 0.239077 Jun 24 16:39:30.549868 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 367/750] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:39:30 2022] GET /compute/v2.1/servers/bd57f4a8-0078-4dde-ac34-901a40bc7b8e => generated 1510 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 16:39:30.565316 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-b977afe4-431b-4538-a9d0-8f20cb026d0a tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 16:39:30.565832 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-b977afe4-431b-4538-a9d0-8f20cb026d0a tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] [instance: bd57f4a8-0078-4dde-ac34-901a40bc7b8e] Fetching instance by UUID {{(pid=102148) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:39:30.573289 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-b977afe4-431b-4538-a9d0-8f20cb026d0a tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:39:30.573735 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-b977afe4-431b-4538-a9d0-8f20cb026d0a tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:39:30.575934 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-b977afe4-431b-4538-a9d0-8f20cb026d0a tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:39:30.575934 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-b977afe4-431b-4538-a9d0-8f20cb026d0a tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:39:30.720389 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-b977afe4-431b-4538-a9d0-8f20cb026d0a tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] 10.222.0.18 "POST /compute/v2.1/servers/bd57f4a8-0078-4dde-ac34-901a40bc7b8e/action" status: 202 len: 0 microversion: 2.1 time: 0.158773 Jun 24 16:39:30.721008 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 384/751] 10.222.0.18 () {60 vars in 1277 bytes} [Fri Jun 24 16:39:30 2022] POST /compute/v2.1/servers/bd57f4a8-0078-4dde-ac34-901a40bc7b8e/action => generated 0 bytes in 160 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 24 16:39:30.728860 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-7a66dd04-c0c8-4527-ab61-0f2eb47c93ce tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] Calling method '>' {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:39:30.729478 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-7a66dd04-c0c8-4527-ab61-0f2eb47c93ce tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] [instance: bd57f4a8-0078-4dde-ac34-901a40bc7b8e] Fetching instance by UUID {{(pid=102149) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:39:30.737688 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-7a66dd04-c0c8-4527-ab61-0f2eb47c93ce tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:39:30.738395 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-7a66dd04-c0c8-4527-ab61-0f2eb47c93ce tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:39:30.739361 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-7a66dd04-c0c8-4527-ab61-0f2eb47c93ce tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:39:30.739962 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-7a66dd04-c0c8-4527-ab61-0f2eb47c93ce tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:39:30.982876 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-7a66dd04-c0c8-4527-ab61-0f2eb47c93ce tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b823267a02a465192aadb5a1c5a3d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34b225f93234ca38c8d0c3d37ba0b8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:39:30.991530 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-7a66dd04-c0c8-4527-ab61-0f2eb47c93ce tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] 10.222.0.18 "GET /compute/v2.1/servers/bd57f4a8-0078-4dde-ac34-901a40bc7b8e" status: 200 len: 1518 microversion: 2.1 time: 0.266224 Jun 24 16:39:30.992113 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 368/752] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:39:30 2022] GET /compute/v2.1/servers/bd57f4a8-0078-4dde-ac34-901a40bc7b8e => generated 1518 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 16:39:32.009729 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-a7a65527-5820-4e24-ae50-2fb89141a6b6 tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] Calling method '>' {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:39:32.010336 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-a7a65527-5820-4e24-ae50-2fb89141a6b6 tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] [instance: bd57f4a8-0078-4dde-ac34-901a40bc7b8e] Fetching instance by UUID {{(pid=102148) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:39:32.018654 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-a7a65527-5820-4e24-ae50-2fb89141a6b6 tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:39:32.019165 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-a7a65527-5820-4e24-ae50-2fb89141a6b6 tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:39:32.019958 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-a7a65527-5820-4e24-ae50-2fb89141a6b6 tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:39:32.020394 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-a7a65527-5820-4e24-ae50-2fb89141a6b6 tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:39:32.242860 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-a7a65527-5820-4e24-ae50-2fb89141a6b6 tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b823267a02a465192aadb5a1c5a3d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34b225f93234ca38c8d0c3d37ba0b8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:39:32.252505 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-a7a65527-5820-4e24-ae50-2fb89141a6b6 tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] 10.222.0.18 "GET /compute/v2.1/servers/bd57f4a8-0078-4dde-ac34-901a40bc7b8e" status: 200 len: 1520 microversion: 2.1 time: 0.246763 Jun 24 16:39:32.253082 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 385/753] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:39:32 2022] GET /compute/v2.1/servers/bd57f4a8-0078-4dde-ac34-901a40bc7b8e => generated 1520 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 16:39:33.269649 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-fed0dc70-68ee-4a7a-8a76-86b93b97bdc6 tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] Calling method '>' {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:39:33.270880 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-fed0dc70-68ee-4a7a-8a76-86b93b97bdc6 tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] [instance: bd57f4a8-0078-4dde-ac34-901a40bc7b8e] Fetching instance by UUID {{(pid=102149) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:39:33.279280 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-fed0dc70-68ee-4a7a-8a76-86b93b97bdc6 tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:39:33.280030 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-fed0dc70-68ee-4a7a-8a76-86b93b97bdc6 tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:39:33.281044 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-fed0dc70-68ee-4a7a-8a76-86b93b97bdc6 tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:39:33.281851 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-fed0dc70-68ee-4a7a-8a76-86b93b97bdc6 tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:39:33.517216 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-fed0dc70-68ee-4a7a-8a76-86b93b97bdc6 tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b823267a02a465192aadb5a1c5a3d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34b225f93234ca38c8d0c3d37ba0b8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:39:33.525555 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-fed0dc70-68ee-4a7a-8a76-86b93b97bdc6 tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] 10.222.0.18 "GET /compute/v2.1/servers/bd57f4a8-0078-4dde-ac34-901a40bc7b8e" status: 200 len: 1520 microversion: 2.1 time: 0.260037 Jun 24 16:39:33.526162 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 369/754] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:39:33 2022] GET /compute/v2.1/servers/bd57f4a8-0078-4dde-ac34-901a40bc7b8e => generated 1520 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 16:39:33.999506 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [req-9d36315e-ea27-4ded-899b-eee08573f6f2 req-f8c871fc-ded0-4d23-9ff7-6a9b5dae33ae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bd57f4a8-0078-4dde-ac34-901a40bc7b8e", "name": "network-vif-unplugged", "status": "completed", "tag": "6d2412c6-1db3-4737-baaa-2744c29fbff8"}]} {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 16:39:34.002165 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 24 16:39:34.002165 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: warnings.warn(msg) Jun 24 16:39:34.012658 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [req-9d36315e-ea27-4ded-899b-eee08573f6f2 req-f8c871fc-ded0-4d23-9ff7-6a9b5dae33ae service nova] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:39:34.013113 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [req-9d36315e-ea27-4ded-899b-eee08573f6f2 req-f8c871fc-ded0-4d23-9ff7-6a9b5dae33ae service nova] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:39:34.030483 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.compute.server_external_events [req-9d36315e-ea27-4ded-899b-eee08573f6f2 req-f8c871fc-ded0-4d23-9ff7-6a9b5dae33ae service nova] Unable to find a host for instance bd57f4a8-0078-4dde-ac34-901a40bc7b8e. Dropping event network-vif-unplugged {{(pid=102148) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:138}} Jun 24 16:39:34.031525 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [req-9d36315e-ea27-4ded-899b-eee08573f6f2 req-f8c871fc-ded0-4d23-9ff7-6a9b5dae33ae service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.036213 Jun 24 16:39:34.032840 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 386/755] 10.222.0.18 () {64 vars in 1317 bytes} [Fri Jun 24 16:39:33 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 38 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jun 24 16:39:34.543155 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-aa94db5e-9cdf-4f12-884c-334ed4466b4f tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] Calling method '>' {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:39:34.543892 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-aa94db5e-9cdf-4f12-884c-334ed4466b4f tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] [instance: bd57f4a8-0078-4dde-ac34-901a40bc7b8e] Fetching instance by UUID {{(pid=102149) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:39:34.552313 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-aa94db5e-9cdf-4f12-884c-334ed4466b4f tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:39:34.553030 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-aa94db5e-9cdf-4f12-884c-334ed4466b4f tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:39:34.554162 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-aa94db5e-9cdf-4f12-884c-334ed4466b4f tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:39:34.554597 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-aa94db5e-9cdf-4f12-884c-334ed4466b4f tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:39:34.815439 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-aa94db5e-9cdf-4f12-884c-334ed4466b4f tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b823267a02a465192aadb5a1c5a3d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34b225f93234ca38c8d0c3d37ba0b8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:39:34.823876 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-aa94db5e-9cdf-4f12-884c-334ed4466b4f tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] 10.222.0.18 "GET /compute/v2.1/servers/bd57f4a8-0078-4dde-ac34-901a40bc7b8e" status: 200 len: 1520 microversion: 2.1 time: 0.284303 Jun 24 16:39:34.832665 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 370/756] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:39:34 2022] GET /compute/v2.1/servers/bd57f4a8-0078-4dde-ac34-901a40bc7b8e => generated 1520 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 16:39:35.802428 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-819de2ef-9082-4a50-ad9d-1de3b668f5cb tempest-TestMinimumBasicScenario-1035681150 tempest-TestMinimumBasicScenario-1035681150-project] Calling method '>' {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:39:35.803072 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-819de2ef-9082-4a50-ad9d-1de3b668f5cb tempest-TestMinimumBasicScenario-1035681150 tempest-TestMinimumBasicScenario-1035681150-project] [instance: 121c5ed1-7baf-4e1a-b849-1c17079ff674] Fetching instance by UUID {{(pid=102148) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:39:35.810157 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-819de2ef-9082-4a50-ad9d-1de3b668f5cb tempest-TestMinimumBasicScenario-1035681150 tempest-TestMinimumBasicScenario-1035681150-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:39:35.810603 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-819de2ef-9082-4a50-ad9d-1de3b668f5cb tempest-TestMinimumBasicScenario-1035681150 tempest-TestMinimumBasicScenario-1035681150-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:39:35.811413 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-819de2ef-9082-4a50-ad9d-1de3b668f5cb tempest-TestMinimumBasicScenario-1035681150 tempest-TestMinimumBasicScenario-1035681150-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:39:35.811848 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-819de2ef-9082-4a50-ad9d-1de3b668f5cb tempest-TestMinimumBasicScenario-1035681150 tempest-TestMinimumBasicScenario-1035681150-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:39:35.841076 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-8152cf15-1cc4-4c62-9ca4-43ad68f8742b tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] Calling method '>' {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:39:35.841727 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-8152cf15-1cc4-4c62-9ca4-43ad68f8742b tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] [instance: bd57f4a8-0078-4dde-ac34-901a40bc7b8e] Fetching instance by UUID {{(pid=102149) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:39:35.848929 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-8152cf15-1cc4-4c62-9ca4-43ad68f8742b tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:39:35.849373 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-8152cf15-1cc4-4c62-9ca4-43ad68f8742b tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:39:35.850143 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-8152cf15-1cc4-4c62-9ca4-43ad68f8742b tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:39:35.850564 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-8152cf15-1cc4-4c62-9ca4-43ad68f8742b tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:39:36.129201 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-819de2ef-9082-4a50-ad9d-1de3b668f5cb tempest-TestMinimumBasicScenario-1035681150 tempest-TestMinimumBasicScenario-1035681150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f875e9c85597441fb83cb9be8ddf91c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2df211bdae44be6b7e0cc41c2cd11e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:39:36.139845 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-819de2ef-9082-4a50-ad9d-1de3b668f5cb tempest-TestMinimumBasicScenario-1035681150 tempest-TestMinimumBasicScenario-1035681150-project] 10.222.0.18 "GET /compute/v2.1/servers/121c5ed1-7baf-4e1a-b849-1c17079ff674" status: 200 len: 1594 microversion: 2.1 time: 0.340821 Jun 24 16:39:36.141001 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 387/757] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:39:35 2022] GET /compute/v2.1/servers/121c5ed1-7baf-4e1a-b849-1c17079ff674 => generated 1594 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 16:39:36.148808 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-8152cf15-1cc4-4c62-9ca4-43ad68f8742b tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b823267a02a465192aadb5a1c5a3d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34b225f93234ca38c8d0c3d37ba0b8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:39:36.157555 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-8152cf15-1cc4-4c62-9ca4-43ad68f8742b tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] 10.222.0.18 "GET /compute/v2.1/servers/bd57f4a8-0078-4dde-ac34-901a40bc7b8e" status: 200 len: 1576 microversion: 2.1 time: 0.320110 Jun 24 16:39:36.158654 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 371/758] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:39:35 2022] GET /compute/v2.1/servers/bd57f4a8-0078-4dde-ac34-901a40bc7b8e => generated 1576 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 16:39:37.175479 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-24c8815c-efaf-4173-ad74-13b56ef0308c tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] Calling method '>' {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:39:37.176158 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-24c8815c-efaf-4173-ad74-13b56ef0308c tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] [instance: bd57f4a8-0078-4dde-ac34-901a40bc7b8e] Fetching instance by UUID {{(pid=102148) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:39:37.183686 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-24c8815c-efaf-4173-ad74-13b56ef0308c tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:39:37.184129 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-24c8815c-efaf-4173-ad74-13b56ef0308c tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:39:37.185227 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-24c8815c-efaf-4173-ad74-13b56ef0308c tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:39:37.185660 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-24c8815c-efaf-4173-ad74-13b56ef0308c tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:39:37.671952 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-24c8815c-efaf-4173-ad74-13b56ef0308c tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b823267a02a465192aadb5a1c5a3d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34b225f93234ca38c8d0c3d37ba0b8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:39:37.681519 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-24c8815c-efaf-4173-ad74-13b56ef0308c tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] 10.222.0.18 "GET /compute/v2.1/servers/bd57f4a8-0078-4dde-ac34-901a40bc7b8e" status: 200 len: 1576 microversion: 2.1 time: 0.511042 Jun 24 16:39:37.682072 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 388/759] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:39:37 2022] GET /compute/v2.1/servers/bd57f4a8-0078-4dde-ac34-901a40bc7b8e => generated 1576 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 16:39:38.699867 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-89e4cbdf-1e67-4495-b224-2b23abde96e5 tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] Calling method '>' {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:39:38.700414 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-89e4cbdf-1e67-4495-b224-2b23abde96e5 tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] [instance: bd57f4a8-0078-4dde-ac34-901a40bc7b8e] Fetching instance by UUID {{(pid=102149) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:39:38.708748 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-89e4cbdf-1e67-4495-b224-2b23abde96e5 tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:39:38.709318 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-89e4cbdf-1e67-4495-b224-2b23abde96e5 tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:39:38.710110 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-89e4cbdf-1e67-4495-b224-2b23abde96e5 tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:39:38.710560 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-89e4cbdf-1e67-4495-b224-2b23abde96e5 tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:39:39.112978 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-89e4cbdf-1e67-4495-b224-2b23abde96e5 tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b823267a02a465192aadb5a1c5a3d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34b225f93234ca38c8d0c3d37ba0b8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:39:39.123291 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-89e4cbdf-1e67-4495-b224-2b23abde96e5 tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] 10.222.0.18 "GET /compute/v2.1/servers/bd57f4a8-0078-4dde-ac34-901a40bc7b8e" status: 200 len: 1576 microversion: 2.1 time: 0.427182 Jun 24 16:39:39.124622 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 372/760] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:39:38 2022] GET /compute/v2.1/servers/bd57f4a8-0078-4dde-ac34-901a40bc7b8e => generated 1576 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 16:39:39.274454 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [req-5f8c2cd2-219b-416f-806f-38322a6e1383 req-09febe2e-5d25-46d4-a1bc-a519b7c08919 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "121c5ed1-7baf-4e1a-b849-1c17079ff674", "tag": "688e29ea-2634-442c-8941-c7390b7f3cc6"}]} {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 16:39:39.277112 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 24 16:39:39.277112 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: warnings.warn(msg) Jun 24 16:39:39.288510 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [req-5f8c2cd2-219b-416f-806f-38322a6e1383 req-09febe2e-5d25-46d4-a1bc-a519b7c08919 service nova] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:39:39.288510 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [req-5f8c2cd2-219b-416f-806f-38322a6e1383 req-09febe2e-5d25-46d4-a1bc-a519b7c08919 service nova] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:39:39.335532 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.compute.server_external_events [req-5f8c2cd2-219b-416f-806f-38322a6e1383 req-09febe2e-5d25-46d4-a1bc-a519b7c08919 service nova] Creating event network-changed:688e29ea-2634-442c-8941-c7390b7f3cc6 for instance 121c5ed1-7baf-4e1a-b849-1c17079ff674 on hv-cinder-84718 Jun 24 16:39:39.349688 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [req-5f8c2cd2-219b-416f-806f-38322a6e1383 req-09febe2e-5d25-46d4-a1bc-a519b7c08919 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080874 Jun 24 16:39:39.351579 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 389/761] 10.222.0.18 () {64 vars in 1317 bytes} [Fri Jun 24 16:39:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 16:39:40.144555 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-8c1a71b7-36c5-4b93-b166-f03f53fe22ce tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] Calling method '>' {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:39:40.145769 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-8c1a71b7-36c5-4b93-b166-f03f53fe22ce tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] [instance: bd57f4a8-0078-4dde-ac34-901a40bc7b8e] Fetching instance by UUID {{(pid=102149) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:39:40.153096 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-8c1a71b7-36c5-4b93-b166-f03f53fe22ce tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:39:40.153544 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-8c1a71b7-36c5-4b93-b166-f03f53fe22ce tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:39:40.154312 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-8c1a71b7-36c5-4b93-b166-f03f53fe22ce tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:39:40.154767 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-8c1a71b7-36c5-4b93-b166-f03f53fe22ce tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:39:40.402046 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-8c1a71b7-36c5-4b93-b166-f03f53fe22ce tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b823267a02a465192aadb5a1c5a3d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34b225f93234ca38c8d0c3d37ba0b8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:39:40.418742 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-8c1a71b7-36c5-4b93-b166-f03f53fe22ce tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] 10.222.0.18 "GET /compute/v2.1/servers/bd57f4a8-0078-4dde-ac34-901a40bc7b8e" status: 200 len: 1576 microversion: 2.1 time: 0.277801 Jun 24 16:39:40.419371 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 373/762] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:39:40 2022] GET /compute/v2.1/servers/bd57f4a8-0078-4dde-ac34-901a40bc7b8e => generated 1576 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 16:39:41.205509 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-972bb5f9-f101-4a9e-9491-deb401578b8b tempest-TestMinimumBasicScenario-1035681150 tempest-TestMinimumBasicScenario-1035681150-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-831328289"}} {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 16:39:41.206757 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-972bb5f9-f101-4a9e-9491-deb401578b8b tempest-TestMinimumBasicScenario-1035681150 tempest-TestMinimumBasicScenario-1035681150-project] [instance: 121c5ed1-7baf-4e1a-b849-1c17079ff674] Fetching instance by UUID {{(pid=102148) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:39:41.218640 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-972bb5f9-f101-4a9e-9491-deb401578b8b tempest-TestMinimumBasicScenario-1035681150 tempest-TestMinimumBasicScenario-1035681150-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:39:41.219473 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-972bb5f9-f101-4a9e-9491-deb401578b8b tempest-TestMinimumBasicScenario-1035681150 tempest-TestMinimumBasicScenario-1035681150-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:39:41.221460 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-972bb5f9-f101-4a9e-9491-deb401578b8b tempest-TestMinimumBasicScenario-1035681150 tempest-TestMinimumBasicScenario-1035681150-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:39:41.222243 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-972bb5f9-f101-4a9e-9491-deb401578b8b tempest-TestMinimumBasicScenario-1035681150 tempest-TestMinimumBasicScenario-1035681150-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:39:41.436297 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-b8809419-4335-4078-8b58-03dc00227ba4 tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] Calling method '>' {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:39:41.437604 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-b8809419-4335-4078-8b58-03dc00227ba4 tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] [instance: bd57f4a8-0078-4dde-ac34-901a40bc7b8e] Fetching instance by UUID {{(pid=102149) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:39:41.444969 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-b8809419-4335-4078-8b58-03dc00227ba4 tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:39:41.445644 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-b8809419-4335-4078-8b58-03dc00227ba4 tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:39:41.446515 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-b8809419-4335-4078-8b58-03dc00227ba4 tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:39:41.447042 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-b8809419-4335-4078-8b58-03dc00227ba4 tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:39:41.476964 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.network.security_group_api [None req-972bb5f9-f101-4a9e-9491-deb401578b8b tempest-TestMinimumBasicScenario-1035681150 tempest-TestMinimumBasicScenario-1035681150-project] Adding security group 3fe36388-f84c-489a-992f-b31b2e32a507 to port 688e29ea-2634-442c-8941-c7390b7f3cc6 Jun 24 16:39:41.799362 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-b8809419-4335-4078-8b58-03dc00227ba4 tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b823267a02a465192aadb5a1c5a3d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34b225f93234ca38c8d0c3d37ba0b8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:39:41.808245 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-b8809419-4335-4078-8b58-03dc00227ba4 tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] 10.222.0.18 "GET /compute/v2.1/servers/bd57f4a8-0078-4dde-ac34-901a40bc7b8e" status: 200 len: 1576 microversion: 2.1 time: 0.375933 Jun 24 16:39:41.809084 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 374/763] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:39:41 2022] GET /compute/v2.1/servers/bd57f4a8-0078-4dde-ac34-901a40bc7b8e => generated 1576 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 16:39:42.201008 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-972bb5f9-f101-4a9e-9491-deb401578b8b tempest-TestMinimumBasicScenario-1035681150 tempest-TestMinimumBasicScenario-1035681150-project] 10.222.0.18 "POST /compute/v2.1/servers/121c5ed1-7baf-4e1a-b849-1c17079ff674/action" status: 202 len: 0 microversion: 2.1 time: 1.003806 Jun 24 16:39:42.201818 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 390/764] 10.222.0.18 () {60 vars in 1277 bytes} [Fri Jun 24 16:39:41 2022] POST /compute/v2.1/servers/121c5ed1-7baf-4e1a-b849-1c17079ff674/action => generated 0 bytes in 1006 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 24 16:39:42.209997 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [req-d0e8090a-f607-49ca-8e6c-e87078b4ba49 req-d91175cb-6e02-4c73-9068-0dda5dca3680 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "121c5ed1-7baf-4e1a-b849-1c17079ff674", "tag": "688e29ea-2634-442c-8941-c7390b7f3cc6"}]} {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 16:39:42.210671 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-97b31125-f0c5-4b58-8aa5-4f5785e2c864 tempest-TestMinimumBasicScenario-1035681150 tempest-TestMinimumBasicScenario-1035681150-project] Calling method '>' {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:39:42.210671 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-97b31125-f0c5-4b58-8aa5-4f5785e2c864 tempest-TestMinimumBasicScenario-1035681150 tempest-TestMinimumBasicScenario-1035681150-project] [instance: 121c5ed1-7baf-4e1a-b849-1c17079ff674] Fetching instance by UUID {{(pid=102149) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:39:42.211613 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 24 16:39:42.211613 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: warnings.warn(msg) Jun 24 16:39:42.221785 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [req-d0e8090a-f607-49ca-8e6c-e87078b4ba49 req-d91175cb-6e02-4c73-9068-0dda5dca3680 service nova] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:39:42.222459 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [req-d0e8090a-f607-49ca-8e6c-e87078b4ba49 req-d91175cb-6e02-4c73-9068-0dda5dca3680 service nova] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:39:42.223496 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-97b31125-f0c5-4b58-8aa5-4f5785e2c864 tempest-TestMinimumBasicScenario-1035681150 tempest-TestMinimumBasicScenario-1035681150-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:39:42.223952 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-97b31125-f0c5-4b58-8aa5-4f5785e2c864 tempest-TestMinimumBasicScenario-1035681150 tempest-TestMinimumBasicScenario-1035681150-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:39:42.224736 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-97b31125-f0c5-4b58-8aa5-4f5785e2c864 tempest-TestMinimumBasicScenario-1035681150 tempest-TestMinimumBasicScenario-1035681150-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:39:42.225169 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-97b31125-f0c5-4b58-8aa5-4f5785e2c864 tempest-TestMinimumBasicScenario-1035681150 tempest-TestMinimumBasicScenario-1035681150-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:39:42.253275 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.compute.server_external_events [req-d0e8090a-f607-49ca-8e6c-e87078b4ba49 req-d91175cb-6e02-4c73-9068-0dda5dca3680 service nova] Creating event network-changed:688e29ea-2634-442c-8941-c7390b7f3cc6 for instance 121c5ed1-7baf-4e1a-b849-1c17079ff674 on hv-cinder-84718 Jun 24 16:39:42.276737 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [req-d0e8090a-f607-49ca-8e6c-e87078b4ba49 req-d91175cb-6e02-4c73-9068-0dda5dca3680 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070204 Jun 24 16:39:42.277529 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 391/765] 10.222.0.18 () {64 vars in 1317 bytes} [Fri Jun 24 16:39:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 16:39:42.526914 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-97b31125-f0c5-4b58-8aa5-4f5785e2c864 tempest-TestMinimumBasicScenario-1035681150 tempest-TestMinimumBasicScenario-1035681150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f875e9c85597441fb83cb9be8ddf91c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2df211bdae44be6b7e0cc41c2cd11e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:39:42.539920 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-97b31125-f0c5-4b58-8aa5-4f5785e2c864 tempest-TestMinimumBasicScenario-1035681150 tempest-TestMinimumBasicScenario-1035681150-project] 10.222.0.18 "GET /compute/v2.1/servers/121c5ed1-7baf-4e1a-b849-1c17079ff674" status: 200 len: 1759 microversion: 2.1 time: 0.333513 Jun 24 16:39:42.541187 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 375/766] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:39:42 2022] GET /compute/v2.1/servers/121c5ed1-7baf-4e1a-b849-1c17079ff674 => generated 1759 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 16:39:42.831182 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-f03f241d-b9d7-475d-b57b-a8957a3d8ea7 tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] Calling method '>' {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:39:42.831705 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-f03f241d-b9d7-475d-b57b-a8957a3d8ea7 tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] [instance: bd57f4a8-0078-4dde-ac34-901a40bc7b8e] Fetching instance by UUID {{(pid=102148) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:39:42.841471 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-f03f241d-b9d7-475d-b57b-a8957a3d8ea7 tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:39:42.842174 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-f03f241d-b9d7-475d-b57b-a8957a3d8ea7 tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:39:42.843172 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-f03f241d-b9d7-475d-b57b-a8957a3d8ea7 tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:39:42.843945 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-f03f241d-b9d7-475d-b57b-a8957a3d8ea7 tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:39:43.112746 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-f03f241d-b9d7-475d-b57b-a8957a3d8ea7 tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b823267a02a465192aadb5a1c5a3d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34b225f93234ca38c8d0c3d37ba0b8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:39:43.121424 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-f03f241d-b9d7-475d-b57b-a8957a3d8ea7 tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] 10.222.0.18 "GET /compute/v2.1/servers/bd57f4a8-0078-4dde-ac34-901a40bc7b8e" status: 200 len: 1576 microversion: 2.1 time: 0.298509 Jun 24 16:39:43.122357 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 392/767] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:39:42 2022] GET /compute/v2.1/servers/bd57f4a8-0078-4dde-ac34-901a40bc7b8e => generated 1576 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 16:39:44.141022 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-11da9df4-173d-4638-9c0a-1eff53848eeb tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] Calling method '>' {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:39:44.141638 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-11da9df4-173d-4638-9c0a-1eff53848eeb tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] [instance: bd57f4a8-0078-4dde-ac34-901a40bc7b8e] Fetching instance by UUID {{(pid=102149) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:39:44.149928 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-11da9df4-173d-4638-9c0a-1eff53848eeb tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:39:44.150387 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-11da9df4-173d-4638-9c0a-1eff53848eeb tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:39:44.151271 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-11da9df4-173d-4638-9c0a-1eff53848eeb tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:39:44.151703 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-11da9df4-173d-4638-9c0a-1eff53848eeb tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:39:44.391993 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-11da9df4-173d-4638-9c0a-1eff53848eeb tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b823267a02a465192aadb5a1c5a3d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34b225f93234ca38c8d0c3d37ba0b8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:39:44.401078 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-11da9df4-173d-4638-9c0a-1eff53848eeb tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] 10.222.0.18 "GET /compute/v2.1/servers/bd57f4a8-0078-4dde-ac34-901a40bc7b8e" status: 200 len: 1576 microversion: 2.1 time: 0.263685 Jun 24 16:39:44.401671 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 376/768] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:39:44 2022] GET /compute/v2.1/servers/bd57f4a8-0078-4dde-ac34-901a40bc7b8e => generated 1576 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 16:39:45.419365 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-bf1889bf-bb77-47ef-ba30-4e37ef06eae1 tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] Calling method '>' {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:39:45.419958 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-bf1889bf-bb77-47ef-ba30-4e37ef06eae1 tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] [instance: bd57f4a8-0078-4dde-ac34-901a40bc7b8e] Fetching instance by UUID {{(pid=102148) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:39:45.428259 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-bf1889bf-bb77-47ef-ba30-4e37ef06eae1 tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:39:45.428711 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-bf1889bf-bb77-47ef-ba30-4e37ef06eae1 tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:39:45.429481 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-bf1889bf-bb77-47ef-ba30-4e37ef06eae1 tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:39:45.429914 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-bf1889bf-bb77-47ef-ba30-4e37ef06eae1 tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:39:45.643828 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-bf1889bf-bb77-47ef-ba30-4e37ef06eae1 tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b823267a02a465192aadb5a1c5a3d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34b225f93234ca38c8d0c3d37ba0b8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:39:45.652730 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-bf1889bf-bb77-47ef-ba30-4e37ef06eae1 tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] 10.222.0.18 "GET /compute/v2.1/servers/bd57f4a8-0078-4dde-ac34-901a40bc7b8e" status: 200 len: 1576 microversion: 2.1 time: 0.236953 Jun 24 16:39:45.653305 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 393/769] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:39:45 2022] GET /compute/v2.1/servers/bd57f4a8-0078-4dde-ac34-901a40bc7b8e => generated 1576 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 16:39:46.672086 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-46550445-7a94-4fe6-979e-c8fd0a8e4ba7 tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] Calling method '>' {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:39:46.672790 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-46550445-7a94-4fe6-979e-c8fd0a8e4ba7 tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] [instance: bd57f4a8-0078-4dde-ac34-901a40bc7b8e] Fetching instance by UUID {{(pid=102149) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:39:46.684816 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-46550445-7a94-4fe6-979e-c8fd0a8e4ba7 tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:39:46.685464 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-46550445-7a94-4fe6-979e-c8fd0a8e4ba7 tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:39:46.686434 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-46550445-7a94-4fe6-979e-c8fd0a8e4ba7 tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:39:46.686999 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-46550445-7a94-4fe6-979e-c8fd0a8e4ba7 tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:39:46.934728 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-46550445-7a94-4fe6-979e-c8fd0a8e4ba7 tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b823267a02a465192aadb5a1c5a3d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34b225f93234ca38c8d0c3d37ba0b8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:39:46.943849 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-46550445-7a94-4fe6-979e-c8fd0a8e4ba7 tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] 10.222.0.18 "GET /compute/v2.1/servers/bd57f4a8-0078-4dde-ac34-901a40bc7b8e" status: 200 len: 1576 microversion: 2.1 time: 0.275949 Jun 24 16:39:46.944428 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 377/770] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:39:46 2022] GET /compute/v2.1/servers/bd57f4a8-0078-4dde-ac34-901a40bc7b8e => generated 1576 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 16:39:47.335024 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-90054d2f-1910-4049-9197-23bc0ebaba15 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Calling method '>' {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:39:47.336072 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-90054d2f-1910-4049-9197-23bc0ebaba15 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] [instance: 72af7667-a283-4567-894f-2bd233c01001] Fetching instance by UUID {{(pid=102148) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:39:47.347640 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-90054d2f-1910-4049-9197-23bc0ebaba15 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:39:47.347640 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-90054d2f-1910-4049-9197-23bc0ebaba15 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:39:47.347640 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-90054d2f-1910-4049-9197-23bc0ebaba15 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:39:47.347640 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-90054d2f-1910-4049-9197-23bc0ebaba15 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:39:47.421063 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-90054d2f-1910-4049-9197-23bc0ebaba15 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] 10.222.0.18 "GET /compute/v2.1/servers/72af7667-a283-4567-894f-2bd233c01001/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.089912 Jun 24 16:39:47.421642 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 394/771] 10.222.0.18 () {60 vars in 1342 bytes} [Fri Jun 24 16:39:47 2022] GET /compute/v2.1/servers/72af7667-a283-4567-894f-2bd233c01001/os-volume_attachments => generated 25 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 16:39:47.513014 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-804c2fa3-8dad-4675-b501-f273c4a55935 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Calling method '>' {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:39:47.513626 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-804c2fa3-8dad-4675-b501-f273c4a55935 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] [instance: 72af7667-a283-4567-894f-2bd233c01001] Fetching instance by UUID {{(pid=102149) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:39:47.521109 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-804c2fa3-8dad-4675-b501-f273c4a55935 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:39:47.521557 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-804c2fa3-8dad-4675-b501-f273c4a55935 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:39:47.522339 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-804c2fa3-8dad-4675-b501-f273c4a55935 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:39:47.522812 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-804c2fa3-8dad-4675-b501-f273c4a55935 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:39:47.587560 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-804c2fa3-8dad-4675-b501-f273c4a55935 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] [instance: 72af7667-a283-4567-894f-2bd233c01001] Going to try to terminate instance {{(pid=102149) delete /opt/stack/nova/nova/compute/api.py:2562}} Jun 24 16:39:47.716731 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-804c2fa3-8dad-4675-b501-f273c4a55935 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] 10.222.0.18 "DELETE /compute/v2.1/servers/72af7667-a283-4567-894f-2bd233c01001" status: 204 len: 0 microversion: 2.20 time: 0.207097 Jun 24 16:39:47.717736 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 378/772] 10.222.0.18 () {60 vars in 1279 bytes} [Fri Jun 24 16:39:47 2022] DELETE /compute/v2.1/servers/72af7667-a283-4567-894f-2bd233c01001 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 24 16:39:47.726268 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-a43d3ab3-091c-4f69-9724-fe2fe2a54d98 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Calling method '>' {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:39:47.726896 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-a43d3ab3-091c-4f69-9724-fe2fe2a54d98 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] [instance: 72af7667-a283-4567-894f-2bd233c01001] Fetching instance by UUID {{(pid=102148) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:39:47.738571 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-a43d3ab3-091c-4f69-9724-fe2fe2a54d98 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:39:47.739045 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-a43d3ab3-091c-4f69-9724-fe2fe2a54d98 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:39:47.739818 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-a43d3ab3-091c-4f69-9724-fe2fe2a54d98 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:39:47.740245 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-a43d3ab3-091c-4f69-9724-fe2fe2a54d98 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:39:47.962061 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-f7837b7f-59f2-48b5-9c62-b12b12783dca tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] Calling method '>' {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:39:47.963088 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-f7837b7f-59f2-48b5-9c62-b12b12783dca tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] [instance: bd57f4a8-0078-4dde-ac34-901a40bc7b8e] Fetching instance by UUID {{(pid=102149) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:39:47.972433 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-f7837b7f-59f2-48b5-9c62-b12b12783dca tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:39:47.973390 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-f7837b7f-59f2-48b5-9c62-b12b12783dca tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:39:47.974756 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-f7837b7f-59f2-48b5-9c62-b12b12783dca tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:39:47.976023 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-f7837b7f-59f2-48b5-9c62-b12b12783dca tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:39:47.982320 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-a43d3ab3-091c-4f69-9724-fe2fe2a54d98 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7489b29cb3ef47d78dfd55794f338b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065254ebe67545639644fcbc6bd9fc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:39:47.994742 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-a43d3ab3-091c-4f69-9724-fe2fe2a54d98 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7489b29cb3ef47d78dfd55794f338b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065254ebe67545639644fcbc6bd9fc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:39:47.996462 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-a43d3ab3-091c-4f69-9724-fe2fe2a54d98 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7489b29cb3ef47d78dfd55794f338b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065254ebe67545639644fcbc6bd9fc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:39:47.997850 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-a43d3ab3-091c-4f69-9724-fe2fe2a54d98 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] 10.222.0.18 "GET /compute/v2.1/servers/72af7667-a283-4567-894f-2bd233c01001" status: 200 len: 1723 microversion: 2.20 time: 0.275319 Jun 24 16:39:47.998476 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 395/773] 10.222.0.18 () {60 vars in 1276 bytes} [Fri Jun 24 16:39:47 2022] GET /compute/v2.1/servers/72af7667-a283-4567-894f-2bd233c01001 => generated 1723 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 16:39:48.184375 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [req-7054910b-43e6-4ec5-ae66-d2caf9056f20 req-35559664-a039-4a6a-83f0-37f9c5e4a1a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bd57f4a8-0078-4dde-ac34-901a40bc7b8e", "name": "network-vif-plugged", "status": "completed", "tag": "6d2412c6-1db3-4737-baaa-2744c29fbff8"}]} {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 16:39:48.185925 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 24 16:39:48.185925 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: warnings.warn(msg) Jun 24 16:39:48.197982 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [req-7054910b-43e6-4ec5-ae66-d2caf9056f20 req-35559664-a039-4a6a-83f0-37f9c5e4a1a0 service nova] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:39:48.198350 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [req-7054910b-43e6-4ec5-ae66-d2caf9056f20 req-35559664-a039-4a6a-83f0-37f9c5e4a1a0 service nova] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:39:48.221861 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.compute.server_external_events [req-7054910b-43e6-4ec5-ae66-d2caf9056f20 req-35559664-a039-4a6a-83f0-37f9c5e4a1a0 service nova] Creating event network-vif-plugged:6d2412c6-1db3-4737-baaa-2744c29fbff8 for instance bd57f4a8-0078-4dde-ac34-901a40bc7b8e on hv-cinder-84718 Jun 24 16:39:48.228457 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [req-7054910b-43e6-4ec5-ae66-d2caf9056f20 req-35559664-a039-4a6a-83f0-37f9c5e4a1a0 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047711 Jun 24 16:39:48.229278 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 396/774] 10.222.0.18 () {64 vars in 1317 bytes} [Fri Jun 24 16:39:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 16:39:48.230248 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-f7837b7f-59f2-48b5-9c62-b12b12783dca tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b823267a02a465192aadb5a1c5a3d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34b225f93234ca38c8d0c3d37ba0b8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:39:48.251163 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-f7837b7f-59f2-48b5-9c62-b12b12783dca tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] 10.222.0.18 "GET /compute/v2.1/servers/bd57f4a8-0078-4dde-ac34-901a40bc7b8e" status: 200 len: 1576 microversion: 2.1 time: 0.292987 Jun 24 16:39:48.253519 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 379/775] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:39:47 2022] GET /compute/v2.1/servers/bd57f4a8-0078-4dde-ac34-901a40bc7b8e => generated 1576 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 16:39:49.023286 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-4d5fa722-3e4d-4222-8806-4179c7ef53f5 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Calling method '>' {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:39:49.024530 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-4d5fa722-3e4d-4222-8806-4179c7ef53f5 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] [instance: 72af7667-a283-4567-894f-2bd233c01001] Fetching instance by UUID {{(pid=102148) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:39:49.036352 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-4d5fa722-3e4d-4222-8806-4179c7ef53f5 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:39:49.036802 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-4d5fa722-3e4d-4222-8806-4179c7ef53f5 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:39:49.037578 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-4d5fa722-3e4d-4222-8806-4179c7ef53f5 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:39:49.037998 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-4d5fa722-3e4d-4222-8806-4179c7ef53f5 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:39:49.249904 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-4d5fa722-3e4d-4222-8806-4179c7ef53f5 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7489b29cb3ef47d78dfd55794f338b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065254ebe67545639644fcbc6bd9fc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:39:49.259402 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-4d5fa722-3e4d-4222-8806-4179c7ef53f5 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7489b29cb3ef47d78dfd55794f338b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065254ebe67545639644fcbc6bd9fc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:39:49.260896 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-4d5fa722-3e4d-4222-8806-4179c7ef53f5 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7489b29cb3ef47d78dfd55794f338b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065254ebe67545639644fcbc6bd9fc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:39:49.262031 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-4d5fa722-3e4d-4222-8806-4179c7ef53f5 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] 10.222.0.18 "GET /compute/v2.1/servers/72af7667-a283-4567-894f-2bd233c01001" status: 200 len: 1723 microversion: 2.20 time: 0.246528 Jun 24 16:39:49.262587 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 397/776] 10.222.0.18 () {60 vars in 1276 bytes} [Fri Jun 24 16:39:49 2022] GET /compute/v2.1/servers/72af7667-a283-4567-894f-2bd233c01001 => generated 1723 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 16:39:49.269647 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-c5cf1b7b-3aae-425c-a58e-6509f1254d34 tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] Calling method '>' {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:39:49.270287 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-c5cf1b7b-3aae-425c-a58e-6509f1254d34 tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] [instance: bd57f4a8-0078-4dde-ac34-901a40bc7b8e] Fetching instance by UUID {{(pid=102149) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:39:49.280113 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-c5cf1b7b-3aae-425c-a58e-6509f1254d34 tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:39:49.280485 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-c5cf1b7b-3aae-425c-a58e-6509f1254d34 tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:39:49.281269 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-c5cf1b7b-3aae-425c-a58e-6509f1254d34 tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:39:49.281699 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-c5cf1b7b-3aae-425c-a58e-6509f1254d34 tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:39:49.506074 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-c5cf1b7b-3aae-425c-a58e-6509f1254d34 tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b823267a02a465192aadb5a1c5a3d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34b225f93234ca38c8d0c3d37ba0b8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:39:49.519052 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-c5cf1b7b-3aae-425c-a58e-6509f1254d34 tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] 10.222.0.18 "GET /compute/v2.1/servers/bd57f4a8-0078-4dde-ac34-901a40bc7b8e" status: 200 len: 1576 microversion: 2.1 time: 0.253309 Jun 24 16:39:49.520012 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 380/777] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:39:49 2022] GET /compute/v2.1/servers/bd57f4a8-0078-4dde-ac34-901a40bc7b8e => generated 1576 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 16:39:50.280400 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-1a8149f6-f3e3-4c01-8a0d-a023fa16e79b tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Calling method '>' {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:39:50.281419 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-1a8149f6-f3e3-4c01-8a0d-a023fa16e79b tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] [instance: 72af7667-a283-4567-894f-2bd233c01001] Fetching instance by UUID {{(pid=102148) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:39:50.292974 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-1a8149f6-f3e3-4c01-8a0d-a023fa16e79b tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:39:50.293734 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-1a8149f6-f3e3-4c01-8a0d-a023fa16e79b tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:39:50.295040 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-1a8149f6-f3e3-4c01-8a0d-a023fa16e79b tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:39:50.295940 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-1a8149f6-f3e3-4c01-8a0d-a023fa16e79b tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:39:50.538645 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-9e155af7-82fc-4609-bf51-6dea16825d14 tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] Calling method '>' {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:39:50.540081 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-9e155af7-82fc-4609-bf51-6dea16825d14 tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] [instance: bd57f4a8-0078-4dde-ac34-901a40bc7b8e] Fetching instance by UUID {{(pid=102149) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:39:50.550170 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-9e155af7-82fc-4609-bf51-6dea16825d14 tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:39:50.550981 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-9e155af7-82fc-4609-bf51-6dea16825d14 tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:39:50.552166 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-9e155af7-82fc-4609-bf51-6dea16825d14 tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:39:50.552800 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-9e155af7-82fc-4609-bf51-6dea16825d14 tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:39:50.606010 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-1a8149f6-f3e3-4c01-8a0d-a023fa16e79b tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7489b29cb3ef47d78dfd55794f338b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065254ebe67545639644fcbc6bd9fc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:39:50.626387 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-1a8149f6-f3e3-4c01-8a0d-a023fa16e79b tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7489b29cb3ef47d78dfd55794f338b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065254ebe67545639644fcbc6bd9fc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:39:50.629030 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-1a8149f6-f3e3-4c01-8a0d-a023fa16e79b tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7489b29cb3ef47d78dfd55794f338b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065254ebe67545639644fcbc6bd9fc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:39:50.630952 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-1a8149f6-f3e3-4c01-8a0d-a023fa16e79b tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] 10.222.0.18 "GET /compute/v2.1/servers/72af7667-a283-4567-894f-2bd233c01001" status: 200 len: 1723 microversion: 2.20 time: 0.354574 Jun 24 16:39:50.631883 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 398/778] 10.222.0.18 () {60 vars in 1276 bytes} [Fri Jun 24 16:39:50 2022] GET /compute/v2.1/servers/72af7667-a283-4567-894f-2bd233c01001 => generated 1723 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 16:39:50.790955 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-9e155af7-82fc-4609-bf51-6dea16825d14 tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b823267a02a465192aadb5a1c5a3d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34b225f93234ca38c8d0c3d37ba0b8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:39:50.803402 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-9e155af7-82fc-4609-bf51-6dea16825d14 tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] 10.222.0.18 "GET /compute/v2.1/servers/bd57f4a8-0078-4dde-ac34-901a40bc7b8e" status: 200 len: 1563 microversion: 2.1 time: 0.270475 Jun 24 16:39:50.805879 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 381/779] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:39:50 2022] GET /compute/v2.1/servers/bd57f4a8-0078-4dde-ac34-901a40bc7b8e => generated 1563 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 16:39:51.651317 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-5d5897fc-30bc-4093-b6a9-ad6cfe38a5f3 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Calling method '>' {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:39:51.652005 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-5d5897fc-30bc-4093-b6a9-ad6cfe38a5f3 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] [instance: 72af7667-a283-4567-894f-2bd233c01001] Fetching instance by UUID {{(pid=102148) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:39:51.660857 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-5d5897fc-30bc-4093-b6a9-ad6cfe38a5f3 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:39:51.661215 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-5d5897fc-30bc-4093-b6a9-ad6cfe38a5f3 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:39:51.662057 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-5d5897fc-30bc-4093-b6a9-ad6cfe38a5f3 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:39:51.662476 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-5d5897fc-30bc-4093-b6a9-ad6cfe38a5f3 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:39:51.799009 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [req-9e9a10ff-269c-4a57-85a5-8d789eaa6ee2 req-5375a9a9-1a91-4cb6-88e5-fec191863a40 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "72af7667-a283-4567-894f-2bd233c01001", "name": "network-vif-deleted", "tag": "87b332d5-d83a-40ca-bb6b-503444dbbfbe"}]} {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 16:39:51.801624 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 24 16:39:51.801624 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: warnings.warn(msg) Jun 24 16:39:51.816401 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [req-9e9a10ff-269c-4a57-85a5-8d789eaa6ee2 req-5375a9a9-1a91-4cb6-88e5-fec191863a40 service nova] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:39:51.817330 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [req-9e9a10ff-269c-4a57-85a5-8d789eaa6ee2 req-5375a9a9-1a91-4cb6-88e5-fec191863a40 service nova] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:39:51.834236 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-5d5897fc-30bc-4093-b6a9-ad6cfe38a5f3 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7489b29cb3ef47d78dfd55794f338b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065254ebe67545639644fcbc6bd9fc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:39:51.877996 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-5d5897fc-30bc-4093-b6a9-ad6cfe38a5f3 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7489b29cb3ef47d78dfd55794f338b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065254ebe67545639644fcbc6bd9fc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:39:51.882336 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-5d5897fc-30bc-4093-b6a9-ad6cfe38a5f3 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7489b29cb3ef47d78dfd55794f338b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065254ebe67545639644fcbc6bd9fc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:39:51.885479 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-5d5897fc-30bc-4093-b6a9-ad6cfe38a5f3 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] 10.222.0.18 "GET /compute/v2.1/servers/72af7667-a283-4567-894f-2bd233c01001" status: 200 len: 1655 microversion: 2.20 time: 0.238239 Jun 24 16:39:51.899688 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 399/780] 10.222.0.18 () {60 vars in 1276 bytes} [Fri Jun 24 16:39:51 2022] GET /compute/v2.1/servers/72af7667-a283-4567-894f-2bd233c01001 => generated 1655 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 16:39:52.036206 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.compute.server_external_events [req-9e9a10ff-269c-4a57-85a5-8d789eaa6ee2 req-5375a9a9-1a91-4cb6-88e5-fec191863a40 service nova] Creating event network-vif-deleted:87b332d5-d83a-40ca-bb6b-503444dbbfbe for instance 72af7667-a283-4567-894f-2bd233c01001 on hv-cinder-84718 Jun 24 16:39:52.041484 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [req-9e9a10ff-269c-4a57-85a5-8d789eaa6ee2 req-5375a9a9-1a91-4cb6-88e5-fec191863a40 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.247952 Jun 24 16:39:52.042080 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 382/781] 10.222.0.18 () {64 vars in 1317 bytes} [Fri Jun 24 16:39:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 16:39:52.914928 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-6284d35a-eb39-43de-b92e-f9f4d51a2753 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Calling method '>' {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:39:52.915567 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-6284d35a-eb39-43de-b92e-f9f4d51a2753 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] [instance: 72af7667-a283-4567-894f-2bd233c01001] Fetching instance by UUID {{(pid=102148) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:39:52.924406 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-6284d35a-eb39-43de-b92e-f9f4d51a2753 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:39:52.925624 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-6284d35a-eb39-43de-b92e-f9f4d51a2753 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:39:52.926434 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-6284d35a-eb39-43de-b92e-f9f4d51a2753 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:39:52.927119 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-6284d35a-eb39-43de-b92e-f9f4d51a2753 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:39:52.989882 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.wsgi [None req-6284d35a-eb39-43de-b92e-f9f4d51a2753 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] HTTP exception thrown: Instance 72af7667-a283-4567-894f-2bd233c01001 could not be found. Jun 24 16:39:52.990932 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-6284d35a-eb39-43de-b92e-f9f4d51a2753 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Returning 404 to user: Instance 72af7667-a283-4567-894f-2bd233c01001 could not be found. {{(pid=102148) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jun 24 16:39:52.992133 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-6284d35a-eb39-43de-b92e-f9f4d51a2753 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] 10.222.0.18 "GET /compute/v2.1/servers/72af7667-a283-4567-894f-2bd233c01001" status: 404 len: 111 microversion: 2.20 time: 0.081963 Jun 24 16:39:52.993446 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 400/782] 10.222.0.18 () {60 vars in 1276 bytes} [Fri Jun 24 16:39:52 2022] GET /compute/v2.1/servers/72af7667-a283-4567-894f-2bd233c01001 => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 24 16:39:53.003263 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-bdaa23a5-86d1-4d31-9f94-c338d62b161d tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Calling method '.version_select at 0x7f1ae8086820>' {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:39:53.025847 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-bdaa23a5-86d1-4d31-9f94-c338d62b161d tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1212064982" status: 204 len: 0 microversion: 2.20 time: 0.026932 Jun 24 16:39:53.029865 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 383/783] 10.222.0.18 () {60 vars in 1261 bytes} [Fri Jun 24 16:39:52 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1212064982 => generated 0 bytes in 29 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 24 16:39:56.908653 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-484a02cd-645a-4a97-ac89-87dab2906117 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Calling method '>' {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:39:56.909542 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-484a02cd-645a-4a97-ac89-87dab2906117 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] [instance: 72af7667-a283-4567-894f-2bd233c01001] Fetching instance by UUID {{(pid=102148) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:39:56.918496 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-484a02cd-645a-4a97-ac89-87dab2906117 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:39:56.918996 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-484a02cd-645a-4a97-ac89-87dab2906117 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:39:56.919761 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-484a02cd-645a-4a97-ac89-87dab2906117 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:39:56.920210 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-484a02cd-645a-4a97-ac89-87dab2906117 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:39:56.974544 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.wsgi [None req-484a02cd-645a-4a97-ac89-87dab2906117 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] HTTP exception thrown: Instance 72af7667-a283-4567-894f-2bd233c01001 could not be found. Jun 24 16:39:56.974942 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-484a02cd-645a-4a97-ac89-87dab2906117 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Returning 404 to user: Instance 72af7667-a283-4567-894f-2bd233c01001 could not be found. {{(pid=102148) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jun 24 16:39:56.975768 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-484a02cd-645a-4a97-ac89-87dab2906117 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] 10.222.0.18 "DELETE /compute/v2.1/servers/72af7667-a283-4567-894f-2bd233c01001" status: 404 len: 111 microversion: 2.20 time: 0.074375 Jun 24 16:39:56.976326 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 401/784] 10.222.0.18 () {60 vars in 1279 bytes} [Fri Jun 24 16:39:56 2022] DELETE /compute/v2.1/servers/72af7667-a283-4567-894f-2bd233c01001 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 24 16:39:56.984569 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-58adc467-334a-4bb1-8c2b-9ecd964f4095 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Calling method '>' {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:39:56.985461 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-58adc467-334a-4bb1-8c2b-9ecd964f4095 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] [instance: 72af7667-a283-4567-894f-2bd233c01001] Fetching instance by UUID {{(pid=102149) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:39:56.994549 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-58adc467-334a-4bb1-8c2b-9ecd964f4095 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:39:56.995036 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-58adc467-334a-4bb1-8c2b-9ecd964f4095 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:39:56.995846 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-58adc467-334a-4bb1-8c2b-9ecd964f4095 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:39:56.996329 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-58adc467-334a-4bb1-8c2b-9ecd964f4095 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:39:57.047592 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.wsgi [None req-58adc467-334a-4bb1-8c2b-9ecd964f4095 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] HTTP exception thrown: Instance 72af7667-a283-4567-894f-2bd233c01001 could not be found. Jun 24 16:39:57.048349 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-58adc467-334a-4bb1-8c2b-9ecd964f4095 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Returning 404 to user: Instance 72af7667-a283-4567-894f-2bd233c01001 could not be found. {{(pid=102149) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jun 24 16:39:57.049364 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-58adc467-334a-4bb1-8c2b-9ecd964f4095 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] 10.222.0.18 "GET /compute/v2.1/servers/72af7667-a283-4567-894f-2bd233c01001" status: 404 len: 111 microversion: 2.20 time: 0.068431 Jun 24 16:39:57.049767 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 384/785] 10.222.0.18 () {60 vars in 1276 bytes} [Fri Jun 24 16:39:56 2022] GET /compute/v2.1/servers/72af7667-a283-4567-894f-2bd233c01001 => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 24 16:39:58.308569 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-37abca9c-b562-49e1-87cf-0dc5e9cc7476 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Calling method '>' {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:39:58.309119 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-37abca9c-b562-49e1-87cf-0dc5e9cc7476 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] [instance: 30b3ffec-7110-4b4d-9482-2451914c166f] Fetching instance by UUID {{(pid=102148) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:39:58.317775 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-37abca9c-b562-49e1-87cf-0dc5e9cc7476 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:39:58.318216 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-37abca9c-b562-49e1-87cf-0dc5e9cc7476 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:39:58.319027 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-37abca9c-b562-49e1-87cf-0dc5e9cc7476 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:39:58.319455 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-37abca9c-b562-49e1-87cf-0dc5e9cc7476 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:39:58.372114 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.wsgi [None req-37abca9c-b562-49e1-87cf-0dc5e9cc7476 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] HTTP exception thrown: Instance 30b3ffec-7110-4b4d-9482-2451914c166f could not be found. Jun 24 16:39:58.372911 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-37abca9c-b562-49e1-87cf-0dc5e9cc7476 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Returning 404 to user: Instance 30b3ffec-7110-4b4d-9482-2451914c166f could not be found. {{(pid=102148) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jun 24 16:39:58.373727 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-37abca9c-b562-49e1-87cf-0dc5e9cc7476 tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] 10.222.0.18 "DELETE /compute/v2.1/servers/30b3ffec-7110-4b4d-9482-2451914c166f" status: 404 len: 111 microversion: 2.20 time: 0.068912 Jun 24 16:39:58.374424 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 402/786] 10.222.0.18 () {60 vars in 1279 bytes} [Fri Jun 24 16:39:58 2022] DELETE /compute/v2.1/servers/30b3ffec-7110-4b4d-9482-2451914c166f => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 24 16:39:58.383808 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-b08fe053-db9e-4e2a-8173-7aad6f5a591f tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Calling method '>' {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:39:58.384427 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-b08fe053-db9e-4e2a-8173-7aad6f5a591f tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] [instance: 30b3ffec-7110-4b4d-9482-2451914c166f] Fetching instance by UUID {{(pid=102149) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:39:58.394107 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-b08fe053-db9e-4e2a-8173-7aad6f5a591f tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:39:58.394545 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-b08fe053-db9e-4e2a-8173-7aad6f5a591f tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:39:58.395344 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-b08fe053-db9e-4e2a-8173-7aad6f5a591f tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:39:58.395771 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-b08fe053-db9e-4e2a-8173-7aad6f5a591f tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:39:58.451313 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.wsgi [None req-b08fe053-db9e-4e2a-8173-7aad6f5a591f tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] HTTP exception thrown: Instance 30b3ffec-7110-4b4d-9482-2451914c166f could not be found. Jun 24 16:39:58.451943 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-b08fe053-db9e-4e2a-8173-7aad6f5a591f tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] Returning 404 to user: Instance 30b3ffec-7110-4b4d-9482-2451914c166f could not be found. {{(pid=102149) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jun 24 16:39:58.452770 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-b08fe053-db9e-4e2a-8173-7aad6f5a591f tempest-AttachVolumeShelveTestJSON-594826425 tempest-AttachVolumeShelveTestJSON-594826425-project] 10.222.0.18 "GET /compute/v2.1/servers/30b3ffec-7110-4b4d-9482-2451914c166f" status: 404 len: 111 microversion: 2.20 time: 0.072814 Jun 24 16:39:58.453318 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 385/787] 10.222.0.18 () {60 vars in 1276 bytes} [Fri Jun 24 16:39:58 2022] GET /compute/v2.1/servers/30b3ffec-7110-4b4d-9482-2451914c166f => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 24 16:40:05.341630 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-3e6ddf5c-b931-40b0-a965-6121588bbd36 tempest-TestMinimumBasicScenario-1035681150 tempest-TestMinimumBasicScenario-1035681150-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 16:40:05.345917 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-3e6ddf5c-b931-40b0-a965-6121588bbd36 tempest-TestMinimumBasicScenario-1035681150 tempest-TestMinimumBasicScenario-1035681150-project] [instance: 121c5ed1-7baf-4e1a-b849-1c17079ff674] Fetching instance by UUID {{(pid=102148) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:40:05.353530 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-3e6ddf5c-b931-40b0-a965-6121588bbd36 tempest-TestMinimumBasicScenario-1035681150 tempest-TestMinimumBasicScenario-1035681150-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:40:05.354227 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-3e6ddf5c-b931-40b0-a965-6121588bbd36 tempest-TestMinimumBasicScenario-1035681150 tempest-TestMinimumBasicScenario-1035681150-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:40:05.355278 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-3e6ddf5c-b931-40b0-a965-6121588bbd36 tempest-TestMinimumBasicScenario-1035681150 tempest-TestMinimumBasicScenario-1035681150-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:40:05.355939 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-3e6ddf5c-b931-40b0-a965-6121588bbd36 tempest-TestMinimumBasicScenario-1035681150 tempest-TestMinimumBasicScenario-1035681150-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:40:05.524597 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-3e6ddf5c-b931-40b0-a965-6121588bbd36 tempest-TestMinimumBasicScenario-1035681150 tempest-TestMinimumBasicScenario-1035681150-project] 10.222.0.18 "POST /compute/v2.1/servers/121c5ed1-7baf-4e1a-b849-1c17079ff674/action" status: 202 len: 0 microversion: 2.1 time: 0.193298 Jun 24 16:40:05.525370 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 403/788] 10.222.0.18 () {60 vars in 1277 bytes} [Fri Jun 24 16:40:05 2022] POST /compute/v2.1/servers/121c5ed1-7baf-4e1a-b849-1c17079ff674/action => generated 0 bytes in 195 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 24 16:40:05.535053 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-0c69c283-1928-40f2-9bf9-d2a40efa6a8f tempest-TestMinimumBasicScenario-1035681150 tempest-TestMinimumBasicScenario-1035681150-project] Calling method '>' {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:40:05.535053 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-0c69c283-1928-40f2-9bf9-d2a40efa6a8f tempest-TestMinimumBasicScenario-1035681150 tempest-TestMinimumBasicScenario-1035681150-project] [instance: 121c5ed1-7baf-4e1a-b849-1c17079ff674] Fetching instance by UUID {{(pid=102149) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:40:05.548704 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-0c69c283-1928-40f2-9bf9-d2a40efa6a8f tempest-TestMinimumBasicScenario-1035681150 tempest-TestMinimumBasicScenario-1035681150-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:40:05.549219 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-0c69c283-1928-40f2-9bf9-d2a40efa6a8f tempest-TestMinimumBasicScenario-1035681150 tempest-TestMinimumBasicScenario-1035681150-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:40:05.550080 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-0c69c283-1928-40f2-9bf9-d2a40efa6a8f tempest-TestMinimumBasicScenario-1035681150 tempest-TestMinimumBasicScenario-1035681150-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:40:05.550517 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-0c69c283-1928-40f2-9bf9-d2a40efa6a8f tempest-TestMinimumBasicScenario-1035681150 tempest-TestMinimumBasicScenario-1035681150-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:40:05.820442 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-0c69c283-1928-40f2-9bf9-d2a40efa6a8f tempest-TestMinimumBasicScenario-1035681150 tempest-TestMinimumBasicScenario-1035681150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f875e9c85597441fb83cb9be8ddf91c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2df211bdae44be6b7e0cc41c2cd11e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:40:05.830585 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-0c69c283-1928-40f2-9bf9-d2a40efa6a8f tempest-TestMinimumBasicScenario-1035681150 tempest-TestMinimumBasicScenario-1035681150-project] 10.222.0.18 "GET /compute/v2.1/servers/121c5ed1-7baf-4e1a-b849-1c17079ff674" status: 200 len: 1751 microversion: 2.1 time: 0.300794 Jun 24 16:40:05.831337 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 386/789] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:40:05 2022] GET /compute/v2.1/servers/121c5ed1-7baf-4e1a-b849-1c17079ff674 => generated 1751 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 16:40:06.854835 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-5a963c52-c7fc-48d0-8d05-0d0fa874bb6f tempest-TestMinimumBasicScenario-1035681150 tempest-TestMinimumBasicScenario-1035681150-project] Calling method '>' {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:40:06.856251 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-5a963c52-c7fc-48d0-8d05-0d0fa874bb6f tempest-TestMinimumBasicScenario-1035681150 tempest-TestMinimumBasicScenario-1035681150-project] [instance: 121c5ed1-7baf-4e1a-b849-1c17079ff674] Fetching instance by UUID {{(pid=102148) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:40:06.864481 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-5a963c52-c7fc-48d0-8d05-0d0fa874bb6f tempest-TestMinimumBasicScenario-1035681150 tempest-TestMinimumBasicScenario-1035681150-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:40:06.865024 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-5a963c52-c7fc-48d0-8d05-0d0fa874bb6f tempest-TestMinimumBasicScenario-1035681150 tempest-TestMinimumBasicScenario-1035681150-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:40:06.865905 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-5a963c52-c7fc-48d0-8d05-0d0fa874bb6f tempest-TestMinimumBasicScenario-1035681150 tempest-TestMinimumBasicScenario-1035681150-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:40:06.866538 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-5a963c52-c7fc-48d0-8d05-0d0fa874bb6f tempest-TestMinimumBasicScenario-1035681150 tempest-TestMinimumBasicScenario-1035681150-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:40:07.319006 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-5a963c52-c7fc-48d0-8d05-0d0fa874bb6f tempest-TestMinimumBasicScenario-1035681150 tempest-TestMinimumBasicScenario-1035681150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f875e9c85597441fb83cb9be8ddf91c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2df211bdae44be6b7e0cc41c2cd11e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:40:07.337341 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-5a963c52-c7fc-48d0-8d05-0d0fa874bb6f tempest-TestMinimumBasicScenario-1035681150 tempest-TestMinimumBasicScenario-1035681150-project] 10.222.0.18 "GET /compute/v2.1/servers/121c5ed1-7baf-4e1a-b849-1c17079ff674" status: 200 len: 1751 microversion: 2.1 time: 0.490738 Jun 24 16:40:07.338799 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 404/790] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:40:06 2022] GET /compute/v2.1/servers/121c5ed1-7baf-4e1a-b849-1c17079ff674 => generated 1751 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 16:40:08.358404 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-1273b62e-a049-4b0f-a64e-e39492d9c556 tempest-TestMinimumBasicScenario-1035681150 tempest-TestMinimumBasicScenario-1035681150-project] Calling method '>' {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:40:08.360730 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-1273b62e-a049-4b0f-a64e-e39492d9c556 tempest-TestMinimumBasicScenario-1035681150 tempest-TestMinimumBasicScenario-1035681150-project] [instance: 121c5ed1-7baf-4e1a-b849-1c17079ff674] Fetching instance by UUID {{(pid=102149) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:40:08.375197 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-1273b62e-a049-4b0f-a64e-e39492d9c556 tempest-TestMinimumBasicScenario-1035681150 tempest-TestMinimumBasicScenario-1035681150-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:40:08.376468 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-1273b62e-a049-4b0f-a64e-e39492d9c556 tempest-TestMinimumBasicScenario-1035681150 tempest-TestMinimumBasicScenario-1035681150-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:40:08.377437 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-1273b62e-a049-4b0f-a64e-e39492d9c556 tempest-TestMinimumBasicScenario-1035681150 tempest-TestMinimumBasicScenario-1035681150-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:40:08.378071 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-1273b62e-a049-4b0f-a64e-e39492d9c556 tempest-TestMinimumBasicScenario-1035681150 tempest-TestMinimumBasicScenario-1035681150-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:40:09.236476 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-1273b62e-a049-4b0f-a64e-e39492d9c556 tempest-TestMinimumBasicScenario-1035681150 tempest-TestMinimumBasicScenario-1035681150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f875e9c85597441fb83cb9be8ddf91c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2df211bdae44be6b7e0cc41c2cd11e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:40:09.255633 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-1273b62e-a049-4b0f-a64e-e39492d9c556 tempest-TestMinimumBasicScenario-1035681150 tempest-TestMinimumBasicScenario-1035681150-project] 10.222.0.18 "GET /compute/v2.1/servers/121c5ed1-7baf-4e1a-b849-1c17079ff674" status: 200 len: 1751 microversion: 2.1 time: 0.904034 Jun 24 16:40:09.278176 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 387/791] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:40:08 2022] GET /compute/v2.1/servers/121c5ed1-7baf-4e1a-b849-1c17079ff674 => generated 1751 bytes in 927 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 16:40:10.273283 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-c1bcddcd-ed31-4e68-bb77-431c4f50e2b7 tempest-TestMinimumBasicScenario-1035681150 tempest-TestMinimumBasicScenario-1035681150-project] Calling method '>' {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:40:10.273958 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-c1bcddcd-ed31-4e68-bb77-431c4f50e2b7 tempest-TestMinimumBasicScenario-1035681150 tempest-TestMinimumBasicScenario-1035681150-project] [instance: 121c5ed1-7baf-4e1a-b849-1c17079ff674] Fetching instance by UUID {{(pid=102148) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:40:10.283888 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-c1bcddcd-ed31-4e68-bb77-431c4f50e2b7 tempest-TestMinimumBasicScenario-1035681150 tempest-TestMinimumBasicScenario-1035681150-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:40:10.285013 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-c1bcddcd-ed31-4e68-bb77-431c4f50e2b7 tempest-TestMinimumBasicScenario-1035681150 tempest-TestMinimumBasicScenario-1035681150-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:40:10.286452 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-c1bcddcd-ed31-4e68-bb77-431c4f50e2b7 tempest-TestMinimumBasicScenario-1035681150 tempest-TestMinimumBasicScenario-1035681150-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:40:10.286452 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-c1bcddcd-ed31-4e68-bb77-431c4f50e2b7 tempest-TestMinimumBasicScenario-1035681150 tempest-TestMinimumBasicScenario-1035681150-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:40:10.918103 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-c1bcddcd-ed31-4e68-bb77-431c4f50e2b7 tempest-TestMinimumBasicScenario-1035681150 tempest-TestMinimumBasicScenario-1035681150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f875e9c85597441fb83cb9be8ddf91c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2df211bdae44be6b7e0cc41c2cd11e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:40:10.928016 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-c1bcddcd-ed31-4e68-bb77-431c4f50e2b7 tempest-TestMinimumBasicScenario-1035681150 tempest-TestMinimumBasicScenario-1035681150-project] 10.222.0.18 "GET /compute/v2.1/servers/121c5ed1-7baf-4e1a-b849-1c17079ff674" status: 200 len: 1756 microversion: 2.1 time: 0.658769 Jun 24 16:40:10.928709 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 405/792] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:40:10 2022] GET /compute/v2.1/servers/121c5ed1-7baf-4e1a-b849-1c17079ff674 => generated 1756 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 16:40:11.945774 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-7bca25f5-b60a-4b35-bb1a-1ae4366479f8 tempest-TestMinimumBasicScenario-1035681150 tempest-TestMinimumBasicScenario-1035681150-project] Calling method '>' {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:40:11.946673 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-7bca25f5-b60a-4b35-bb1a-1ae4366479f8 tempest-TestMinimumBasicScenario-1035681150 tempest-TestMinimumBasicScenario-1035681150-project] [instance: 121c5ed1-7baf-4e1a-b849-1c17079ff674] Fetching instance by UUID {{(pid=102149) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:40:11.956334 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-7bca25f5-b60a-4b35-bb1a-1ae4366479f8 tempest-TestMinimumBasicScenario-1035681150 tempest-TestMinimumBasicScenario-1035681150-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:40:11.957226 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-7bca25f5-b60a-4b35-bb1a-1ae4366479f8 tempest-TestMinimumBasicScenario-1035681150 tempest-TestMinimumBasicScenario-1035681150-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:40:11.958130 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-7bca25f5-b60a-4b35-bb1a-1ae4366479f8 tempest-TestMinimumBasicScenario-1035681150 tempest-TestMinimumBasicScenario-1035681150-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:40:11.958714 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-7bca25f5-b60a-4b35-bb1a-1ae4366479f8 tempest-TestMinimumBasicScenario-1035681150 tempest-TestMinimumBasicScenario-1035681150-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:40:12.496880 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-7bca25f5-b60a-4b35-bb1a-1ae4366479f8 tempest-TestMinimumBasicScenario-1035681150 tempest-TestMinimumBasicScenario-1035681150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f875e9c85597441fb83cb9be8ddf91c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2df211bdae44be6b7e0cc41c2cd11e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:40:12.506789 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-7bca25f5-b60a-4b35-bb1a-1ae4366479f8 tempest-TestMinimumBasicScenario-1035681150 tempest-TestMinimumBasicScenario-1035681150-project] 10.222.0.18 "GET /compute/v2.1/servers/121c5ed1-7baf-4e1a-b849-1c17079ff674" status: 200 len: 1756 microversion: 2.1 time: 0.564861 Jun 24 16:40:12.507365 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 388/793] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:40:11 2022] GET /compute/v2.1/servers/121c5ed1-7baf-4e1a-b849-1c17079ff674 => generated 1756 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 16:40:12.915826 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-047a410d-4935-45d3-b2db-e2ebb3fa3ee7 tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1308889756", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-306670203", "security_groups": [{"name": "tempest-secgroup-smoke-1405128976"}], "block_device_mapping_v2": [{"uuid": "4e3dbc62-d6a1-42a7-8b50-6fe6662f302e", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "e44350f6-4ad8-4a19-8963-bdb0aaadab4f"}]}} {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 16:40:13.110393 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.network.neutron [None req-047a410d-4935-45d3-b2db-e2ebb3fa3ee7 tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] validate_networks() for [('e44350f6-4ad8-4a19-8963-bdb0aaadab4f', None, None, None)] {{(pid=102148) validate_networks /opt/stack/nova/nova/network/neutron.py:2367}} Jun 24 16:40:13.599389 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-6df10e2f-144a-4c4c-96c7-4a670fad4fd9 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Action: 'create', calling method: .version_select at 0x7f1ae2ff7670>, body: {"keypair": {"name": "tempest-keypair-1116509597", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCJHzoxZiy6sC0YJ7D5k7tqpr+MPjDmn2DFJZ2q5oyAAe7j7JIvLhYViCoFs6ehuNozezQZqTJ9NaBQikRdG5mjAoIEX4vrvMUtbG6PhDK1Y6cBRVI3d0qKuvfKd2NfXDg=="}} {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 16:40:13.624920 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.quota [None req-6df10e2f-144a-4c4c-96c7-4a670fad4fd9 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Getting quotas for project b03d0f5f955c49f48e6f06aaa5aae5f4. Resources: {'key_pairs'} {{(pid=102149) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jun 24 16:40:13.630538 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.quota [None req-6df10e2f-144a-4c4c-96c7-4a670fad4fd9 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Getting quotas for user a5ba17c9390249878062ee1b003e9d3a and project b03d0f5f955c49f48e6f06aaa5aae5f4. Resources: {'key_pairs'} {{(pid=102149) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jun 24 16:40:13.657939 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-6df10e2f-144a-4c4c-96c7-4a670fad4fd9 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.202111 Jun 24 16:40:13.658681 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 389/794] 10.222.0.18 () {60 vars in 1158 bytes} [Fri Jun 24 16:40:13 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 16:40:13.663245 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-88f2fd65-55e9-4847-a5a8-d7632fc55e4c tempest-TestMinimumBasicScenario-1035681150 tempest-TestMinimumBasicScenario-1035681150-project] Calling method '>' {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:40:13.663859 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-88f2fd65-55e9-4847-a5a8-d7632fc55e4c tempest-TestMinimumBasicScenario-1035681150 tempest-TestMinimumBasicScenario-1035681150-project] [instance: 121c5ed1-7baf-4e1a-b849-1c17079ff674] Fetching instance by UUID {{(pid=102149) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:40:13.673219 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-88f2fd65-55e9-4847-a5a8-d7632fc55e4c tempest-TestMinimumBasicScenario-1035681150 tempest-TestMinimumBasicScenario-1035681150-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:40:13.673219 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-88f2fd65-55e9-4847-a5a8-d7632fc55e4c tempest-TestMinimumBasicScenario-1035681150 tempest-TestMinimumBasicScenario-1035681150-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:40:13.674256 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-88f2fd65-55e9-4847-a5a8-d7632fc55e4c tempest-TestMinimumBasicScenario-1035681150 tempest-TestMinimumBasicScenario-1035681150-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:40:13.674450 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-88f2fd65-55e9-4847-a5a8-d7632fc55e4c tempest-TestMinimumBasicScenario-1035681150 tempest-TestMinimumBasicScenario-1035681150-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:40:13.759944 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.virt.hardware [None req-047a410d-4935-45d3-b2db-e2ebb3fa3ee7 tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Flavor limits 0:0:0 {{(pid=102148) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 24 16:40:13.760374 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.virt.hardware [None req-047a410d-4935-45d3-b2db-e2ebb3fa3ee7 tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Image limits 0:0:0 {{(pid=102148) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 24 16:40:13.760851 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.virt.hardware [None req-047a410d-4935-45d3-b2db-e2ebb3fa3ee7 tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Flavor pref 0:0:0 {{(pid=102148) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 24 16:40:13.761266 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.virt.hardware [None req-047a410d-4935-45d3-b2db-e2ebb3fa3ee7 tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Image pref 0:0:0 {{(pid=102148) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 24 16:40:13.761675 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.virt.hardware [None req-047a410d-4935-45d3-b2db-e2ebb3fa3ee7 tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=102148) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 24 16:40:13.771980 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-047a410d-4935-45d3-b2db-e2ebb3fa3ee7 tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:40:13.772508 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-047a410d-4935-45d3-b2db-e2ebb3fa3ee7 tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:40:13.773299 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-047a410d-4935-45d3-b2db-e2ebb3fa3ee7 tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:40:13.773728 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-047a410d-4935-45d3-b2db-e2ebb3fa3ee7 tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:40:13.792842 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.quota [None req-047a410d-4935-45d3-b2db-e2ebb3fa3ee7 tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Getting quotas for project 901fbc33d59d49f8afa7f06d62e19e16. Resources: {'ram', 'instances', 'cores'} {{(pid=102148) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jun 24 16:40:13.799070 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.quota [None req-047a410d-4935-45d3-b2db-e2ebb3fa3ee7 tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Getting quotas for user 65d11cab328748d5a8f5e55eb439e334 and project 901fbc33d59d49f8afa7f06d62e19e16. Resources: {'ram', 'instances', 'cores'} {{(pid=102148) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jun 24 16:40:13.952810 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-88f2fd65-55e9-4847-a5a8-d7632fc55e4c tempest-TestMinimumBasicScenario-1035681150 tempest-TestMinimumBasicScenario-1035681150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f875e9c85597441fb83cb9be8ddf91c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2df211bdae44be6b7e0cc41c2cd11e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:40:13.957395 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-047a410d-4935-45d3-b2db-e2ebb3fa3ee7 tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Going to run 1 instances... {{(pid=102148) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Jun 24 16:40:13.959908 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-047a410d-4935-45d3-b2db-e2ebb3fa3ee7 tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] [instance: 45111d6d-035d-465f-8cd8-aaebebeca3e7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='4e3dbc62-d6a1-42a7-8b50-6fe6662f302e',volume_size=None,volume_type=None)] {{(pid=102148) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1684}} Jun 24 16:40:13.971794 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-88f2fd65-55e9-4847-a5a8-d7632fc55e4c tempest-TestMinimumBasicScenario-1035681150 tempest-TestMinimumBasicScenario-1035681150-project] 10.222.0.18 "GET /compute/v2.1/servers/121c5ed1-7baf-4e1a-b849-1c17079ff674" status: 200 len: 1756 microversion: 2.1 time: 0.311896 Jun 24 16:40:13.972461 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 390/795] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:40:13 2022] GET /compute/v2.1/servers/121c5ed1-7baf-4e1a-b849-1c17079ff674 => generated 1756 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 16:40:14.171617 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-047a410d-4935-45d3-b2db-e2ebb3fa3ee7 tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.259435 Jun 24 16:40:14.173861 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 406/796] 10.222.0.18 () {60 vars in 1146 bytes} [Fri Jun 24 16:40:12 2022] POST /compute/v2.1/servers => generated 406 bytes in 1263 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 24 16:40:14.186163 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-d61c2c37-7bdf-4bed-af41-6cea20fe50cc tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Calling method '>' {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:40:14.186980 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-d61c2c37-7bdf-4bed-af41-6cea20fe50cc tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] [instance: 45111d6d-035d-465f-8cd8-aaebebeca3e7] Fetching instance by UUID {{(pid=102149) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:40:14.288899 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-d61c2c37-7bdf-4bed-af41-6cea20fe50cc tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65d11cab328748d5a8f5e55eb439e334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901fbc33d59d49f8afa7f06d62e19e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:40:14.297428 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-d61c2c37-7bdf-4bed-af41-6cea20fe50cc tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] 10.222.0.18 "GET /compute/v2.1/servers/45111d6d-035d-465f-8cd8-aaebebeca3e7" status: 200 len: 1094 microversion: 2.1 time: 0.115115 Jun 24 16:40:14.307795 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 391/797] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:40:14 2022] GET /compute/v2.1/servers/45111d6d-035d-465f-8cd8-aaebebeca3e7 => generated 1094 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 16:40:14.990322 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-5b62f36c-79b8-40ae-b188-733a9864a78f tempest-TestMinimumBasicScenario-1035681150 tempest-TestMinimumBasicScenario-1035681150-project] Calling method '>' {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:40:14.991595 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-5b62f36c-79b8-40ae-b188-733a9864a78f tempest-TestMinimumBasicScenario-1035681150 tempest-TestMinimumBasicScenario-1035681150-project] [instance: 121c5ed1-7baf-4e1a-b849-1c17079ff674] Fetching instance by UUID {{(pid=102148) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:40:14.999010 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-5b62f36c-79b8-40ae-b188-733a9864a78f tempest-TestMinimumBasicScenario-1035681150 tempest-TestMinimumBasicScenario-1035681150-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:40:14.999707 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-5b62f36c-79b8-40ae-b188-733a9864a78f tempest-TestMinimumBasicScenario-1035681150 tempest-TestMinimumBasicScenario-1035681150-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:40:15.001066 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-5b62f36c-79b8-40ae-b188-733a9864a78f tempest-TestMinimumBasicScenario-1035681150 tempest-TestMinimumBasicScenario-1035681150-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:40:15.001677 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-5b62f36c-79b8-40ae-b188-733a9864a78f tempest-TestMinimumBasicScenario-1035681150 tempest-TestMinimumBasicScenario-1035681150-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:40:15.316647 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-c6b05269-a377-4701-a6bd-772115bfd120 tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Calling method '>' {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:40:15.317254 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-c6b05269-a377-4701-a6bd-772115bfd120 tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] [instance: 45111d6d-035d-465f-8cd8-aaebebeca3e7] Fetching instance by UUID {{(pid=102149) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:40:15.363938 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-c6b05269-a377-4701-a6bd-772115bfd120 tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:40:15.364648 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-c6b05269-a377-4701-a6bd-772115bfd120 tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:40:15.375724 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-c6b05269-a377-4701-a6bd-772115bfd120 tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:40:15.380658 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-c6b05269-a377-4701-a6bd-772115bfd120 tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:40:15.479595 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-5b62f36c-79b8-40ae-b188-733a9864a78f tempest-TestMinimumBasicScenario-1035681150 tempest-TestMinimumBasicScenario-1035681150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f875e9c85597441fb83cb9be8ddf91c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2df211bdae44be6b7e0cc41c2cd11e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:40:15.498958 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-5b62f36c-79b8-40ae-b188-733a9864a78f tempest-TestMinimumBasicScenario-1035681150 tempest-TestMinimumBasicScenario-1035681150-project] 10.222.0.18 "GET /compute/v2.1/servers/121c5ed1-7baf-4e1a-b849-1c17079ff674" status: 200 len: 1756 microversion: 2.1 time: 0.512295 Jun 24 16:40:15.499553 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 407/798] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:40:14 2022] GET /compute/v2.1/servers/121c5ed1-7baf-4e1a-b849-1c17079ff674 => generated 1756 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 16:40:15.824332 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-c6b05269-a377-4701-a6bd-772115bfd120 tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65d11cab328748d5a8f5e55eb439e334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901fbc33d59d49f8afa7f06d62e19e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:40:15.835406 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-c6b05269-a377-4701-a6bd-772115bfd120 tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] 10.222.0.18 "GET /compute/v2.1/servers/45111d6d-035d-465f-8cd8-aaebebeca3e7" status: 200 len: 1200 microversion: 2.1 time: 0.523596 Jun 24 16:40:15.846877 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 392/799] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:40:15 2022] GET /compute/v2.1/servers/45111d6d-035d-465f-8cd8-aaebebeca3e7 => generated 1200 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 16:40:16.434118 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-d55e4e39-78b8-4d00-8cd4-047117713757 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-16041290", "imageRef": "113c9cfb-6cee-4018-9e63-66fae82b3851", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f2bcec95-87e3-41fe-8d12-671e0679c896"}], "security_groups": [{"name": "tempest-securitygroup--691799799"}], "key_name": "tempest-keypair-1116509597", "user_data": "}} {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 16:40:16.525194 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-4572c183-10f3-4471-8351-5ee87fbc2229 tempest-TestMinimumBasicScenario-1035681150 tempest-TestMinimumBasicScenario-1035681150-project] Calling method '>' {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:40:16.527113 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-4572c183-10f3-4471-8351-5ee87fbc2229 tempest-TestMinimumBasicScenario-1035681150 tempest-TestMinimumBasicScenario-1035681150-project] [instance: 121c5ed1-7baf-4e1a-b849-1c17079ff674] Fetching instance by UUID {{(pid=102149) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:40:16.550771 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-4572c183-10f3-4471-8351-5ee87fbc2229 tempest-TestMinimumBasicScenario-1035681150 tempest-TestMinimumBasicScenario-1035681150-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:40:16.552228 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-4572c183-10f3-4471-8351-5ee87fbc2229 tempest-TestMinimumBasicScenario-1035681150 tempest-TestMinimumBasicScenario-1035681150-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:40:16.553282 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-4572c183-10f3-4471-8351-5ee87fbc2229 tempest-TestMinimumBasicScenario-1035681150 tempest-TestMinimumBasicScenario-1035681150-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:40:16.553960 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-4572c183-10f3-4471-8351-5ee87fbc2229 tempest-TestMinimumBasicScenario-1035681150 tempest-TestMinimumBasicScenario-1035681150-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:40:16.641837 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.network.neutron [None req-d55e4e39-78b8-4d00-8cd4-047117713757 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] validate_networks() for [('f2bcec95-87e3-41fe-8d12-671e0679c896', None, None, None)] {{(pid=102148) validate_networks /opt/stack/nova/nova/network/neutron.py:2367}} Jun 24 16:40:17.273293 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-4572c183-10f3-4471-8351-5ee87fbc2229 tempest-TestMinimumBasicScenario-1035681150 tempest-TestMinimumBasicScenario-1035681150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f875e9c85597441fb83cb9be8ddf91c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2df211bdae44be6b7e0cc41c2cd11e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:40:17.284869 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-4572c183-10f3-4471-8351-5ee87fbc2229 tempest-TestMinimumBasicScenario-1035681150 tempest-TestMinimumBasicScenario-1035681150-project] 10.222.0.18 "GET /compute/v2.1/servers/121c5ed1-7baf-4e1a-b849-1c17079ff674" status: 200 len: 1756 microversion: 2.1 time: 0.763352 Jun 24 16:40:17.310976 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 393/800] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:40:16 2022] GET /compute/v2.1/servers/121c5ed1-7baf-4e1a-b849-1c17079ff674 => generated 1756 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 16:40:17.319425 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-35a36c46-826a-4d8d-bfde-aeb72fc7583e tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Calling method '>' {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:40:17.321505 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-35a36c46-826a-4d8d-bfde-aeb72fc7583e tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] [instance: 45111d6d-035d-465f-8cd8-aaebebeca3e7] Fetching instance by UUID {{(pid=102149) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:40:17.342233 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-35a36c46-826a-4d8d-bfde-aeb72fc7583e tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:40:17.345608 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-35a36c46-826a-4d8d-bfde-aeb72fc7583e tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:40:17.351711 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-35a36c46-826a-4d8d-bfde-aeb72fc7583e tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:40:17.353114 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-35a36c46-826a-4d8d-bfde-aeb72fc7583e tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:40:17.884027 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-35a36c46-826a-4d8d-bfde-aeb72fc7583e tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65d11cab328748d5a8f5e55eb439e334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901fbc33d59d49f8afa7f06d62e19e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:40:17.893155 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-35a36c46-826a-4d8d-bfde-aeb72fc7583e tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] 10.222.0.18 "GET /compute/v2.1/servers/45111d6d-035d-465f-8cd8-aaebebeca3e7" status: 200 len: 1278 microversion: 2.1 time: 0.580850 Jun 24 16:40:17.893830 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 394/801] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:40:17 2022] GET /compute/v2.1/servers/45111d6d-035d-465f-8cd8-aaebebeca3e7 => generated 1278 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 16:40:17.921594 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.virt.hardware [None req-d55e4e39-78b8-4d00-8cd4-047117713757 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Flavor limits 0:0:0 {{(pid=102148) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 24 16:40:17.922237 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.virt.hardware [None req-d55e4e39-78b8-4d00-8cd4-047117713757 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Image limits 0:0:0 {{(pid=102148) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 24 16:40:17.922545 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.virt.hardware [None req-d55e4e39-78b8-4d00-8cd4-047117713757 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Flavor pref 0:0:0 {{(pid=102148) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 24 16:40:17.923003 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.virt.hardware [None req-d55e4e39-78b8-4d00-8cd4-047117713757 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Image pref 0:0:0 {{(pid=102148) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 24 16:40:17.923609 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.virt.hardware [None req-d55e4e39-78b8-4d00-8cd4-047117713757 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=102148) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 24 16:40:17.932855 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-d55e4e39-78b8-4d00-8cd4-047117713757 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:40:17.933309 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-d55e4e39-78b8-4d00-8cd4-047117713757 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:40:17.934192 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-d55e4e39-78b8-4d00-8cd4-047117713757 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:40:17.934650 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-d55e4e39-78b8-4d00-8cd4-047117713757 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:40:17.956574 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.quota [None req-d55e4e39-78b8-4d00-8cd4-047117713757 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Getting quotas for project b03d0f5f955c49f48e6f06aaa5aae5f4. Resources: {'ram', 'instances', 'cores'} {{(pid=102148) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jun 24 16:40:17.960576 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.quota [None req-d55e4e39-78b8-4d00-8cd4-047117713757 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Getting quotas for user a5ba17c9390249878062ee1b003e9d3a and project b03d0f5f955c49f48e6f06aaa5aae5f4. Resources: {'ram', 'instances', 'cores'} {{(pid=102148) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jun 24 16:40:17.971604 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-d55e4e39-78b8-4d00-8cd4-047117713757 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Going to run 1 instances... {{(pid=102148) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Jun 24 16:40:17.973805 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-d55e4e39-78b8-4d00-8cd4-047117713757 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] [instance: bbc30718-1530-42df-bb08-c3418a02180f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='113c9cfb-6cee-4018-9e63-66fae82b3851',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=102148) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1684}} Jun 24 16:40:18.021912 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-d55e4e39-78b8-4d00-8cd4-047117713757 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.594123 Jun 24 16:40:18.022782 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 408/802] 10.222.0.18 () {60 vars in 1146 bytes} [Fri Jun 24 16:40:16 2022] POST /compute/v2.1/servers => generated 401 bytes in 1596 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 24 16:40:18.038393 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-98471145-361e-42ae-b116-30fbcbbf0bc5 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Calling method '>' {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:40:18.039507 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-98471145-361e-42ae-b116-30fbcbbf0bc5 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] [instance: bbc30718-1530-42df-bb08-c3418a02180f] Fetching instance by UUID {{(pid=102149) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:40:18.136039 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-98471145-361e-42ae-b116-30fbcbbf0bc5 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5ba17c9390249878062ee1b003e9d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b03d0f5f955c49f48e6f06aaa5aae5f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:40:18.151466 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-98471145-361e-42ae-b116-30fbcbbf0bc5 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] 10.222.0.18 "GET /compute/v2.1/servers/bbc30718-1530-42df-bb08-c3418a02180f" status: 200 len: 1236 microversion: 2.1 time: 0.122049 Jun 24 16:40:18.152290 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 395/803] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:40:18 2022] GET /compute/v2.1/servers/bbc30718-1530-42df-bb08-c3418a02180f => generated 1236 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 16:40:18.303605 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-f71ef425-5585-4cd3-90b4-7bc77c42c2c2 tempest-TestMinimumBasicScenario-1035681150 tempest-TestMinimumBasicScenario-1035681150-project] Calling method '>' {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:40:18.304255 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-f71ef425-5585-4cd3-90b4-7bc77c42c2c2 tempest-TestMinimumBasicScenario-1035681150 tempest-TestMinimumBasicScenario-1035681150-project] [instance: 121c5ed1-7baf-4e1a-b849-1c17079ff674] Fetching instance by UUID {{(pid=102148) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:40:18.312025 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-f71ef425-5585-4cd3-90b4-7bc77c42c2c2 tempest-TestMinimumBasicScenario-1035681150 tempest-TestMinimumBasicScenario-1035681150-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:40:18.312556 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-f71ef425-5585-4cd3-90b4-7bc77c42c2c2 tempest-TestMinimumBasicScenario-1035681150 tempest-TestMinimumBasicScenario-1035681150-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:40:18.314040 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-f71ef425-5585-4cd3-90b4-7bc77c42c2c2 tempest-TestMinimumBasicScenario-1035681150 tempest-TestMinimumBasicScenario-1035681150-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:40:18.314643 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-f71ef425-5585-4cd3-90b4-7bc77c42c2c2 tempest-TestMinimumBasicScenario-1035681150 tempest-TestMinimumBasicScenario-1035681150-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:40:18.553681 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-f71ef425-5585-4cd3-90b4-7bc77c42c2c2 tempest-TestMinimumBasicScenario-1035681150 tempest-TestMinimumBasicScenario-1035681150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f875e9c85597441fb83cb9be8ddf91c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2df211bdae44be6b7e0cc41c2cd11e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:40:18.564031 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-f71ef425-5585-4cd3-90b4-7bc77c42c2c2 tempest-TestMinimumBasicScenario-1035681150 tempest-TestMinimumBasicScenario-1035681150-project] 10.222.0.18 "GET /compute/v2.1/servers/121c5ed1-7baf-4e1a-b849-1c17079ff674" status: 200 len: 1756 microversion: 2.1 time: 0.264197 Jun 24 16:40:18.564520 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 409/804] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:40:18 2022] GET /compute/v2.1/servers/121c5ed1-7baf-4e1a-b849-1c17079ff674 => generated 1756 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 16:40:18.909204 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-12290cbc-b32e-437d-8778-01ad2fcc2a7c tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Calling method '>' {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:40:18.909803 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-12290cbc-b32e-437d-8778-01ad2fcc2a7c tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] [instance: 45111d6d-035d-465f-8cd8-aaebebeca3e7] Fetching instance by UUID {{(pid=102149) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:40:18.917609 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-12290cbc-b32e-437d-8778-01ad2fcc2a7c tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:40:18.918052 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-12290cbc-b32e-437d-8778-01ad2fcc2a7c tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:40:18.918839 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-12290cbc-b32e-437d-8778-01ad2fcc2a7c tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:40:18.919266 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-12290cbc-b32e-437d-8778-01ad2fcc2a7c tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:40:19.150609 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-12290cbc-b32e-437d-8778-01ad2fcc2a7c tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65d11cab328748d5a8f5e55eb439e334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901fbc33d59d49f8afa7f06d62e19e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:40:19.159481 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-12290cbc-b32e-437d-8778-01ad2fcc2a7c tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] 10.222.0.18 "GET /compute/v2.1/servers/45111d6d-035d-465f-8cd8-aaebebeca3e7" status: 200 len: 1278 microversion: 2.1 time: 0.253924 Jun 24 16:40:19.160381 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 396/805] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:40:18 2022] GET /compute/v2.1/servers/45111d6d-035d-465f-8cd8-aaebebeca3e7 => generated 1278 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 16:40:19.168291 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-59ac546a-6efe-48ce-8d8a-a1f8b315095f tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Calling method '>' {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:40:19.168909 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-59ac546a-6efe-48ce-8d8a-a1f8b315095f tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] [instance: bbc30718-1530-42df-bb08-c3418a02180f] Fetching instance by UUID {{(pid=102148) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:40:19.176866 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-59ac546a-6efe-48ce-8d8a-a1f8b315095f tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:40:19.177318 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-59ac546a-6efe-48ce-8d8a-a1f8b315095f tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:40:19.178125 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-59ac546a-6efe-48ce-8d8a-a1f8b315095f tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:40:19.178567 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-59ac546a-6efe-48ce-8d8a-a1f8b315095f tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:40:19.313681 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-59ac546a-6efe-48ce-8d8a-a1f8b315095f tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5ba17c9390249878062ee1b003e9d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b03d0f5f955c49f48e6f06aaa5aae5f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:40:19.326920 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-59ac546a-6efe-48ce-8d8a-a1f8b315095f tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] 10.222.0.18 "GET /compute/v2.1/servers/bbc30718-1530-42df-bb08-c3418a02180f" status: 200 len: 1240 microversion: 2.1 time: 0.161751 Jun 24 16:40:19.327966 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 410/806] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:40:19 2022] GET /compute/v2.1/servers/bbc30718-1530-42df-bb08-c3418a02180f => generated 1240 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 16:40:19.581133 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-fc26f426-5502-4460-a8fc-916372663f03 tempest-TestMinimumBasicScenario-1035681150 tempest-TestMinimumBasicScenario-1035681150-project] Calling method '>' {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:40:19.581906 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-fc26f426-5502-4460-a8fc-916372663f03 tempest-TestMinimumBasicScenario-1035681150 tempest-TestMinimumBasicScenario-1035681150-project] [instance: 121c5ed1-7baf-4e1a-b849-1c17079ff674] Fetching instance by UUID {{(pid=102149) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:40:19.589243 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-fc26f426-5502-4460-a8fc-916372663f03 tempest-TestMinimumBasicScenario-1035681150 tempest-TestMinimumBasicScenario-1035681150-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:40:19.589689 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-fc26f426-5502-4460-a8fc-916372663f03 tempest-TestMinimumBasicScenario-1035681150 tempest-TestMinimumBasicScenario-1035681150-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:40:19.590472 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-fc26f426-5502-4460-a8fc-916372663f03 tempest-TestMinimumBasicScenario-1035681150 tempest-TestMinimumBasicScenario-1035681150-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:40:19.590934 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-fc26f426-5502-4460-a8fc-916372663f03 tempest-TestMinimumBasicScenario-1035681150 tempest-TestMinimumBasicScenario-1035681150-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:40:19.816049 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-fc26f426-5502-4460-a8fc-916372663f03 tempest-TestMinimumBasicScenario-1035681150 tempest-TestMinimumBasicScenario-1035681150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f875e9c85597441fb83cb9be8ddf91c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2df211bdae44be6b7e0cc41c2cd11e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:40:19.826942 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-fc26f426-5502-4460-a8fc-916372663f03 tempest-TestMinimumBasicScenario-1035681150 tempest-TestMinimumBasicScenario-1035681150-project] 10.222.0.18 "GET /compute/v2.1/servers/121c5ed1-7baf-4e1a-b849-1c17079ff674" status: 200 len: 1756 microversion: 2.1 time: 0.249629 Jun 24 16:40:19.829194 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 397/807] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:40:19 2022] GET /compute/v2.1/servers/121c5ed1-7baf-4e1a-b849-1c17079ff674 => generated 1756 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 16:40:20.177529 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-aca4642f-2570-4e11-920c-da66616562cf tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Calling method '>' {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:40:20.180351 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-aca4642f-2570-4e11-920c-da66616562cf tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] [instance: 45111d6d-035d-465f-8cd8-aaebebeca3e7] Fetching instance by UUID {{(pid=102148) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:40:20.190163 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-aca4642f-2570-4e11-920c-da66616562cf tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:40:20.190682 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-aca4642f-2570-4e11-920c-da66616562cf tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:40:20.191478 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-aca4642f-2570-4e11-920c-da66616562cf tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:40:20.191966 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-aca4642f-2570-4e11-920c-da66616562cf tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:40:20.349247 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-f0e99daa-5e95-4e7e-921f-a5b744f6b38b tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Calling method '>' {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:40:20.350567 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-f0e99daa-5e95-4e7e-921f-a5b744f6b38b tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] [instance: bbc30718-1530-42df-bb08-c3418a02180f] Fetching instance by UUID {{(pid=102149) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:40:20.359039 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-f0e99daa-5e95-4e7e-921f-a5b744f6b38b tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:40:20.366867 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-f0e99daa-5e95-4e7e-921f-a5b744f6b38b tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:40:20.368506 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-f0e99daa-5e95-4e7e-921f-a5b744f6b38b tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:40:20.369132 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-f0e99daa-5e95-4e7e-921f-a5b744f6b38b tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:40:20.547561 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-f0e99daa-5e95-4e7e-921f-a5b744f6b38b tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5ba17c9390249878062ee1b003e9d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b03d0f5f955c49f48e6f06aaa5aae5f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:40:20.580361 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-f0e99daa-5e95-4e7e-921f-a5b744f6b38b tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] 10.222.0.18 "GET /compute/v2.1/servers/bbc30718-1530-42df-bb08-c3418a02180f" status: 200 len: 1288 microversion: 2.1 time: 0.234674 Jun 24 16:40:20.581051 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 398/808] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:40:20 2022] GET /compute/v2.1/servers/bbc30718-1530-42df-bb08-c3418a02180f => generated 1288 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 16:40:20.638093 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-aca4642f-2570-4e11-920c-da66616562cf tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65d11cab328748d5a8f5e55eb439e334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901fbc33d59d49f8afa7f06d62e19e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:40:20.648907 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-aca4642f-2570-4e11-920c-da66616562cf tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] 10.222.0.18 "GET /compute/v2.1/servers/45111d6d-035d-465f-8cd8-aaebebeca3e7" status: 200 len: 1266 microversion: 2.1 time: 0.475337 Jun 24 16:40:20.660856 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 411/809] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:40:20 2022] GET /compute/v2.1/servers/45111d6d-035d-465f-8cd8-aaebebeca3e7 => generated 1266 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 16:40:20.845338 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-ac97f3f4-5284-4dbe-8578-a090bca7fb63 tempest-TestMinimumBasicScenario-1035681150 tempest-TestMinimumBasicScenario-1035681150-project] Calling method '>' {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:40:20.846190 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-ac97f3f4-5284-4dbe-8578-a090bca7fb63 tempest-TestMinimumBasicScenario-1035681150 tempest-TestMinimumBasicScenario-1035681150-project] [instance: 121c5ed1-7baf-4e1a-b849-1c17079ff674] Fetching instance by UUID {{(pid=102149) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:40:20.853533 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-ac97f3f4-5284-4dbe-8578-a090bca7fb63 tempest-TestMinimumBasicScenario-1035681150 tempest-TestMinimumBasicScenario-1035681150-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:40:20.854271 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-ac97f3f4-5284-4dbe-8578-a090bca7fb63 tempest-TestMinimumBasicScenario-1035681150 tempest-TestMinimumBasicScenario-1035681150-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:40:20.855675 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-ac97f3f4-5284-4dbe-8578-a090bca7fb63 tempest-TestMinimumBasicScenario-1035681150 tempest-TestMinimumBasicScenario-1035681150-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:40:20.856858 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-ac97f3f4-5284-4dbe-8578-a090bca7fb63 tempest-TestMinimumBasicScenario-1035681150 tempest-TestMinimumBasicScenario-1035681150-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:40:21.204803 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [req-f0b8dab2-317b-400d-9282-b0ac7912d0c0 req-c18427d6-acac-4220-ba08-b450fbb5f7a0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "45111d6d-035d-465f-8cd8-aaebebeca3e7", "tag": "5ca97655-924b-4e05-814b-f5434e316687"}]} {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 16:40:21.211526 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 24 16:40:21.211526 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: warnings.warn(msg) Jun 24 16:40:21.237572 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [req-f0b8dab2-317b-400d-9282-b0ac7912d0c0 req-c18427d6-acac-4220-ba08-b450fbb5f7a0 service nova] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:40:21.238367 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [req-f0b8dab2-317b-400d-9282-b0ac7912d0c0 req-c18427d6-acac-4220-ba08-b450fbb5f7a0 service nova] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:40:21.260303 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.compute.server_external_events [req-f0b8dab2-317b-400d-9282-b0ac7912d0c0 req-c18427d6-acac-4220-ba08-b450fbb5f7a0 service nova] Creating event network-changed:5ca97655-924b-4e05-814b-f5434e316687 for instance 45111d6d-035d-465f-8cd8-aaebebeca3e7 on hv-cinder-84718 Jun 24 16:40:21.272619 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [req-f0b8dab2-317b-400d-9282-b0ac7912d0c0 req-c18427d6-acac-4220-ba08-b450fbb5f7a0 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072327 Jun 24 16:40:21.273402 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 412/810] 10.222.0.18 () {64 vars in 1317 bytes} [Fri Jun 24 16:40:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 16:40:21.289923 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-ac97f3f4-5284-4dbe-8578-a090bca7fb63 tempest-TestMinimumBasicScenario-1035681150 tempest-TestMinimumBasicScenario-1035681150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f875e9c85597441fb83cb9be8ddf91c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2df211bdae44be6b7e0cc41c2cd11e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:40:21.331859 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-ac97f3f4-5284-4dbe-8578-a090bca7fb63 tempest-TestMinimumBasicScenario-1035681150 tempest-TestMinimumBasicScenario-1035681150-project] 10.222.0.18 "GET /compute/v2.1/servers/121c5ed1-7baf-4e1a-b849-1c17079ff674" status: 200 len: 1756 microversion: 2.1 time: 0.490252 Jun 24 16:40:21.333703 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 399/811] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:40:20 2022] GET /compute/v2.1/servers/121c5ed1-7baf-4e1a-b849-1c17079ff674 => generated 1756 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 16:40:21.600991 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-4ac44b02-aeba-4926-bcad-1a907297a23c tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Calling method '>' {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:40:21.602303 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-4ac44b02-aeba-4926-bcad-1a907297a23c tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] [instance: bbc30718-1530-42df-bb08-c3418a02180f] Fetching instance by UUID {{(pid=102148) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:40:21.611617 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-4ac44b02-aeba-4926-bcad-1a907297a23c tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:40:21.612812 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-4ac44b02-aeba-4926-bcad-1a907297a23c tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:40:21.614450 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-4ac44b02-aeba-4926-bcad-1a907297a23c tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:40:21.615009 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-4ac44b02-aeba-4926-bcad-1a907297a23c tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:40:21.667182 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-140f03d4-a38d-46d1-b604-ed12fd5928d7 tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Calling method '>' {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:40:21.667796 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-140f03d4-a38d-46d1-b604-ed12fd5928d7 tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] [instance: 45111d6d-035d-465f-8cd8-aaebebeca3e7] Fetching instance by UUID {{(pid=102149) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:40:21.675845 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-140f03d4-a38d-46d1-b604-ed12fd5928d7 tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:40:21.676786 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-140f03d4-a38d-46d1-b604-ed12fd5928d7 tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:40:21.677690 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-140f03d4-a38d-46d1-b604-ed12fd5928d7 tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:40:21.678298 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-140f03d4-a38d-46d1-b604-ed12fd5928d7 tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:40:21.901807 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-4ac44b02-aeba-4926-bcad-1a907297a23c tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5ba17c9390249878062ee1b003e9d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b03d0f5f955c49f48e6f06aaa5aae5f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:40:21.912845 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-4ac44b02-aeba-4926-bcad-1a907297a23c tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] 10.222.0.18 "GET /compute/v2.1/servers/bbc30718-1530-42df-bb08-c3418a02180f" status: 200 len: 1294 microversion: 2.1 time: 0.318349 Jun 24 16:40:21.915142 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 413/812] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:40:21 2022] GET /compute/v2.1/servers/bbc30718-1530-42df-bb08-c3418a02180f => generated 1294 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 16:40:22.155973 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-140f03d4-a38d-46d1-b604-ed12fd5928d7 tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65d11cab328748d5a8f5e55eb439e334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901fbc33d59d49f8afa7f06d62e19e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:40:22.167874 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-140f03d4-a38d-46d1-b604-ed12fd5928d7 tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] 10.222.0.18 "GET /compute/v2.1/servers/45111d6d-035d-465f-8cd8-aaebebeca3e7" status: 200 len: 1266 microversion: 2.1 time: 0.504775 Jun 24 16:40:22.178249 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 400/813] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:40:21 2022] GET /compute/v2.1/servers/45111d6d-035d-465f-8cd8-aaebebeca3e7 => generated 1266 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 16:40:22.359088 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-c47c6388-6561-4a88-9bac-ba5b6fe2bfc5 tempest-TestMinimumBasicScenario-1035681150 tempest-TestMinimumBasicScenario-1035681150-project] Calling method '>' {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:40:22.360389 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-c47c6388-6561-4a88-9bac-ba5b6fe2bfc5 tempest-TestMinimumBasicScenario-1035681150 tempest-TestMinimumBasicScenario-1035681150-project] [instance: 121c5ed1-7baf-4e1a-b849-1c17079ff674] Fetching instance by UUID {{(pid=102148) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:40:22.384147 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-c47c6388-6561-4a88-9bac-ba5b6fe2bfc5 tempest-TestMinimumBasicScenario-1035681150 tempest-TestMinimumBasicScenario-1035681150-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:40:22.384603 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-c47c6388-6561-4a88-9bac-ba5b6fe2bfc5 tempest-TestMinimumBasicScenario-1035681150 tempest-TestMinimumBasicScenario-1035681150-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:40:22.385394 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-c47c6388-6561-4a88-9bac-ba5b6fe2bfc5 tempest-TestMinimumBasicScenario-1035681150 tempest-TestMinimumBasicScenario-1035681150-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:40:22.385832 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-c47c6388-6561-4a88-9bac-ba5b6fe2bfc5 tempest-TestMinimumBasicScenario-1035681150 tempest-TestMinimumBasicScenario-1035681150-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:40:22.821259 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-c47c6388-6561-4a88-9bac-ba5b6fe2bfc5 tempest-TestMinimumBasicScenario-1035681150 tempest-TestMinimumBasicScenario-1035681150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f875e9c85597441fb83cb9be8ddf91c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2df211bdae44be6b7e0cc41c2cd11e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:40:22.832064 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-c47c6388-6561-4a88-9bac-ba5b6fe2bfc5 tempest-TestMinimumBasicScenario-1035681150 tempest-TestMinimumBasicScenario-1035681150-project] 10.222.0.18 "GET /compute/v2.1/servers/121c5ed1-7baf-4e1a-b849-1c17079ff674" status: 200 len: 1756 microversion: 2.1 time: 0.480092 Jun 24 16:40:22.833119 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 414/814] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:40:22 2022] GET /compute/v2.1/servers/121c5ed1-7baf-4e1a-b849-1c17079ff674 => generated 1756 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 16:40:22.931806 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-36c1a2f0-4b9c-408b-a178-c150894ce2d2 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Calling method '>' {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:40:22.933081 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-36c1a2f0-4b9c-408b-a178-c150894ce2d2 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] [instance: bbc30718-1530-42df-bb08-c3418a02180f] Fetching instance by UUID {{(pid=102149) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:40:22.940984 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-36c1a2f0-4b9c-408b-a178-c150894ce2d2 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:40:22.941508 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-36c1a2f0-4b9c-408b-a178-c150894ce2d2 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:40:22.942280 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-36c1a2f0-4b9c-408b-a178-c150894ce2d2 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:40:22.942733 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-36c1a2f0-4b9c-408b-a178-c150894ce2d2 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:40:23.185847 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-1e37aaae-fabc-423b-a344-257f90b950c1 tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Calling method '>' {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:40:23.186463 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-1e37aaae-fabc-423b-a344-257f90b950c1 tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] [instance: 45111d6d-035d-465f-8cd8-aaebebeca3e7] Fetching instance by UUID {{(pid=102148) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:40:23.197070 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-1e37aaae-fabc-423b-a344-257f90b950c1 tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:40:23.197530 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-1e37aaae-fabc-423b-a344-257f90b950c1 tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:40:23.198333 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-1e37aaae-fabc-423b-a344-257f90b950c1 tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:40:23.198803 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-1e37aaae-fabc-423b-a344-257f90b950c1 tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:40:23.533130 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-36c1a2f0-4b9c-408b-a178-c150894ce2d2 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5ba17c9390249878062ee1b003e9d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b03d0f5f955c49f48e6f06aaa5aae5f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:40:23.545008 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-36c1a2f0-4b9c-408b-a178-c150894ce2d2 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] 10.222.0.18 "GET /compute/v2.1/servers/bbc30718-1530-42df-bb08-c3418a02180f" status: 200 len: 1361 microversion: 2.1 time: 0.616119 Jun 24 16:40:23.545852 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 401/815] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:40:22 2022] GET /compute/v2.1/servers/bbc30718-1530-42df-bb08-c3418a02180f => generated 1361 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 16:40:23.550866 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [req-2d1b3a37-ece3-4af4-80a7-546ccc2df33b req-12fe1747-6047-4beb-a550-5fc266361a51 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bbc30718-1530-42df-bb08-c3418a02180f", "tag": "42daa041-fdc0-4dfb-bf9b-d0e86576ac6d"}]} {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 16:40:23.553027 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 24 16:40:23.553027 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: warnings.warn(msg) Jun 24 16:40:23.563788 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [req-2d1b3a37-ece3-4af4-80a7-546ccc2df33b req-12fe1747-6047-4beb-a550-5fc266361a51 service nova] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:40:23.564432 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [req-2d1b3a37-ece3-4af4-80a7-546ccc2df33b req-12fe1747-6047-4beb-a550-5fc266361a51 service nova] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:40:23.582160 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.compute.server_external_events [req-2d1b3a37-ece3-4af4-80a7-546ccc2df33b req-12fe1747-6047-4beb-a550-5fc266361a51 service nova] Creating event network-changed:42daa041-fdc0-4dfb-bf9b-d0e86576ac6d for instance bbc30718-1530-42df-bb08-c3418a02180f on hv-cinder-84718 Jun 24 16:40:23.606792 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [req-2d1b3a37-ece3-4af4-80a7-546ccc2df33b req-12fe1747-6047-4beb-a550-5fc266361a51 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058972 Jun 24 16:40:23.607446 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 402/816] 10.222.0.18 () {64 vars in 1317 bytes} [Fri Jun 24 16:40:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 16:40:23.660638 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-1e37aaae-fabc-423b-a344-257f90b950c1 tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65d11cab328748d5a8f5e55eb439e334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901fbc33d59d49f8afa7f06d62e19e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:40:23.675900 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-1e37aaae-fabc-423b-a344-257f90b950c1 tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] 10.222.0.18 "GET /compute/v2.1/servers/45111d6d-035d-465f-8cd8-aaebebeca3e7" status: 200 len: 1266 microversion: 2.1 time: 0.494169 Jun 24 16:40:23.676498 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 415/817] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:40:23 2022] GET /compute/v2.1/servers/45111d6d-035d-465f-8cd8-aaebebeca3e7 => generated 1266 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 16:40:23.856614 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-c168688d-fbe0-44f2-82d0-c594b4ddfab3 tempest-TestMinimumBasicScenario-1035681150 tempest-TestMinimumBasicScenario-1035681150-project] Calling method '>' {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:40:23.860558 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-c168688d-fbe0-44f2-82d0-c594b4ddfab3 tempest-TestMinimumBasicScenario-1035681150 tempest-TestMinimumBasicScenario-1035681150-project] [instance: 121c5ed1-7baf-4e1a-b849-1c17079ff674] Fetching instance by UUID {{(pid=102149) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:40:23.876211 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-c168688d-fbe0-44f2-82d0-c594b4ddfab3 tempest-TestMinimumBasicScenario-1035681150 tempest-TestMinimumBasicScenario-1035681150-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:40:23.877185 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-c168688d-fbe0-44f2-82d0-c594b4ddfab3 tempest-TestMinimumBasicScenario-1035681150 tempest-TestMinimumBasicScenario-1035681150-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:40:23.878215 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-c168688d-fbe0-44f2-82d0-c594b4ddfab3 tempest-TestMinimumBasicScenario-1035681150 tempest-TestMinimumBasicScenario-1035681150-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:40:23.878885 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-c168688d-fbe0-44f2-82d0-c594b4ddfab3 tempest-TestMinimumBasicScenario-1035681150 tempest-TestMinimumBasicScenario-1035681150-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:40:24.150575 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-c168688d-fbe0-44f2-82d0-c594b4ddfab3 tempest-TestMinimumBasicScenario-1035681150 tempest-TestMinimumBasicScenario-1035681150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f875e9c85597441fb83cb9be8ddf91c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2df211bdae44be6b7e0cc41c2cd11e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:40:24.162339 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-c168688d-fbe0-44f2-82d0-c594b4ddfab3 tempest-TestMinimumBasicScenario-1035681150 tempest-TestMinimumBasicScenario-1035681150-project] 10.222.0.18 "GET /compute/v2.1/servers/121c5ed1-7baf-4e1a-b849-1c17079ff674" status: 200 len: 1756 microversion: 2.1 time: 0.312242 Jun 24 16:40:24.163306 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 403/818] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:40:23 2022] GET /compute/v2.1/servers/121c5ed1-7baf-4e1a-b849-1c17079ff674 => generated 1756 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 16:40:24.564416 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-b0cc357b-6fbf-4af2-bb4d-b4e213636078 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Calling method '>' {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:40:24.565140 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-b0cc357b-6fbf-4af2-bb4d-b4e213636078 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] [instance: bbc30718-1530-42df-bb08-c3418a02180f] Fetching instance by UUID {{(pid=102148) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:40:24.573326 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-b0cc357b-6fbf-4af2-bb4d-b4e213636078 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:40:24.573779 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-b0cc357b-6fbf-4af2-bb4d-b4e213636078 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:40:24.574555 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-b0cc357b-6fbf-4af2-bb4d-b4e213636078 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:40:24.575030 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-b0cc357b-6fbf-4af2-bb4d-b4e213636078 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:40:24.698172 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-90984448-2190-4095-8162-d4d3807731f4 tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Calling method '>' {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:40:24.698834 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-90984448-2190-4095-8162-d4d3807731f4 tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] [instance: 45111d6d-035d-465f-8cd8-aaebebeca3e7] Fetching instance by UUID {{(pid=102149) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:40:24.706909 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-90984448-2190-4095-8162-d4d3807731f4 tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:40:24.707464 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-90984448-2190-4095-8162-d4d3807731f4 tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:40:24.708315 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-90984448-2190-4095-8162-d4d3807731f4 tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:40:24.708818 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-90984448-2190-4095-8162-d4d3807731f4 tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:40:24.839624 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-b0cc357b-6fbf-4af2-bb4d-b4e213636078 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5ba17c9390249878062ee1b003e9d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b03d0f5f955c49f48e6f06aaa5aae5f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:40:24.848098 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-b0cc357b-6fbf-4af2-bb4d-b4e213636078 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] 10.222.0.18 "GET /compute/v2.1/servers/bbc30718-1530-42df-bb08-c3418a02180f" status: 200 len: 1361 microversion: 2.1 time: 0.290346 Jun 24 16:40:24.848675 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 416/819] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:40:24 2022] GET /compute/v2.1/servers/bbc30718-1530-42df-bb08-c3418a02180f => generated 1361 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 16:40:24.931033 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-90984448-2190-4095-8162-d4d3807731f4 tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65d11cab328748d5a8f5e55eb439e334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901fbc33d59d49f8afa7f06d62e19e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:40:24.939865 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-90984448-2190-4095-8162-d4d3807731f4 tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] 10.222.0.18 "GET /compute/v2.1/servers/45111d6d-035d-465f-8cd8-aaebebeca3e7" status: 200 len: 1266 microversion: 2.1 time: 0.248410 Jun 24 16:40:24.940434 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 404/820] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:40:24 2022] GET /compute/v2.1/servers/45111d6d-035d-465f-8cd8-aaebebeca3e7 => generated 1266 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 16:40:25.179973 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-a2d4c663-68c9-4c7b-ae9d-ab26a96a23f1 tempest-TestMinimumBasicScenario-1035681150 tempest-TestMinimumBasicScenario-1035681150-project] Calling method '>' {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:40:25.180574 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-a2d4c663-68c9-4c7b-ae9d-ab26a96a23f1 tempest-TestMinimumBasicScenario-1035681150 tempest-TestMinimumBasicScenario-1035681150-project] [instance: 121c5ed1-7baf-4e1a-b849-1c17079ff674] Fetching instance by UUID {{(pid=102148) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:40:25.187883 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-a2d4c663-68c9-4c7b-ae9d-ab26a96a23f1 tempest-TestMinimumBasicScenario-1035681150 tempest-TestMinimumBasicScenario-1035681150-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:40:25.188322 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-a2d4c663-68c9-4c7b-ae9d-ab26a96a23f1 tempest-TestMinimumBasicScenario-1035681150 tempest-TestMinimumBasicScenario-1035681150-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:40:25.189078 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-a2d4c663-68c9-4c7b-ae9d-ab26a96a23f1 tempest-TestMinimumBasicScenario-1035681150 tempest-TestMinimumBasicScenario-1035681150-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:40:25.189504 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-a2d4c663-68c9-4c7b-ae9d-ab26a96a23f1 tempest-TestMinimumBasicScenario-1035681150 tempest-TestMinimumBasicScenario-1035681150-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:40:25.405295 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-a2d4c663-68c9-4c7b-ae9d-ab26a96a23f1 tempest-TestMinimumBasicScenario-1035681150 tempest-TestMinimumBasicScenario-1035681150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f875e9c85597441fb83cb9be8ddf91c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2df211bdae44be6b7e0cc41c2cd11e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:40:25.414912 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-a2d4c663-68c9-4c7b-ae9d-ab26a96a23f1 tempest-TestMinimumBasicScenario-1035681150 tempest-TestMinimumBasicScenario-1035681150-project] 10.222.0.18 "GET /compute/v2.1/servers/121c5ed1-7baf-4e1a-b849-1c17079ff674" status: 200 len: 1756 microversion: 2.1 time: 0.238538 Jun 24 16:40:25.415469 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 417/821] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:40:25 2022] GET /compute/v2.1/servers/121c5ed1-7baf-4e1a-b849-1c17079ff674 => generated 1756 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 16:40:25.867893 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-fa98033a-9ac2-45cd-928a-dcd479d97f4d tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Calling method '>' {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:40:25.868487 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-fa98033a-9ac2-45cd-928a-dcd479d97f4d tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] [instance: bbc30718-1530-42df-bb08-c3418a02180f] Fetching instance by UUID {{(pid=102149) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:40:25.876205 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-fa98033a-9ac2-45cd-928a-dcd479d97f4d tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:40:25.876645 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-fa98033a-9ac2-45cd-928a-dcd479d97f4d tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:40:25.877403 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-fa98033a-9ac2-45cd-928a-dcd479d97f4d tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:40:25.877832 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-fa98033a-9ac2-45cd-928a-dcd479d97f4d tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:40:25.957724 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-203c3acb-a0a8-4847-9ab2-faaaede39ae5 tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Calling method '>' {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:40:25.958418 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-203c3acb-a0a8-4847-9ab2-faaaede39ae5 tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] [instance: 45111d6d-035d-465f-8cd8-aaebebeca3e7] Fetching instance by UUID {{(pid=102148) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:40:25.965862 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-203c3acb-a0a8-4847-9ab2-faaaede39ae5 tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:40:25.966391 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-203c3acb-a0a8-4847-9ab2-faaaede39ae5 tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:40:25.967250 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-203c3acb-a0a8-4847-9ab2-faaaede39ae5 tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:40:25.967744 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-203c3acb-a0a8-4847-9ab2-faaaede39ae5 tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:40:26.144326 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-fa98033a-9ac2-45cd-928a-dcd479d97f4d tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5ba17c9390249878062ee1b003e9d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b03d0f5f955c49f48e6f06aaa5aae5f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:40:26.152346 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-fa98033a-9ac2-45cd-928a-dcd479d97f4d tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] 10.222.0.18 "GET /compute/v2.1/servers/bbc30718-1530-42df-bb08-c3418a02180f" status: 200 len: 1361 microversion: 2.1 time: 0.289516 Jun 24 16:40:26.153110 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 405/822] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:40:25 2022] GET /compute/v2.1/servers/bbc30718-1530-42df-bb08-c3418a02180f => generated 1361 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 16:40:26.211891 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-203c3acb-a0a8-4847-9ab2-faaaede39ae5 tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65d11cab328748d5a8f5e55eb439e334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901fbc33d59d49f8afa7f06d62e19e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:40:26.220108 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-203c3acb-a0a8-4847-9ab2-faaaede39ae5 tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] 10.222.0.18 "GET /compute/v2.1/servers/45111d6d-035d-465f-8cd8-aaebebeca3e7" status: 200 len: 1266 microversion: 2.1 time: 0.266053 Jun 24 16:40:26.220679 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 418/823] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:40:25 2022] GET /compute/v2.1/servers/45111d6d-035d-465f-8cd8-aaebebeca3e7 => generated 1266 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 16:40:26.431785 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-25fbd4f6-2e30-4685-9c67-36b2a54ed187 tempest-TestMinimumBasicScenario-1035681150 tempest-TestMinimumBasicScenario-1035681150-project] Calling method '>' {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:40:26.432399 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-25fbd4f6-2e30-4685-9c67-36b2a54ed187 tempest-TestMinimumBasicScenario-1035681150 tempest-TestMinimumBasicScenario-1035681150-project] [instance: 121c5ed1-7baf-4e1a-b849-1c17079ff674] Fetching instance by UUID {{(pid=102149) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:40:26.440744 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-25fbd4f6-2e30-4685-9c67-36b2a54ed187 tempest-TestMinimumBasicScenario-1035681150 tempest-TestMinimumBasicScenario-1035681150-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:40:26.441200 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-25fbd4f6-2e30-4685-9c67-36b2a54ed187 tempest-TestMinimumBasicScenario-1035681150 tempest-TestMinimumBasicScenario-1035681150-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:40:26.442013 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-25fbd4f6-2e30-4685-9c67-36b2a54ed187 tempest-TestMinimumBasicScenario-1035681150 tempest-TestMinimumBasicScenario-1035681150-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:40:26.442453 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-25fbd4f6-2e30-4685-9c67-36b2a54ed187 tempest-TestMinimumBasicScenario-1035681150 tempest-TestMinimumBasicScenario-1035681150-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:40:26.664334 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-25fbd4f6-2e30-4685-9c67-36b2a54ed187 tempest-TestMinimumBasicScenario-1035681150 tempest-TestMinimumBasicScenario-1035681150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f875e9c85597441fb83cb9be8ddf91c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2df211bdae44be6b7e0cc41c2cd11e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:40:26.673510 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-25fbd4f6-2e30-4685-9c67-36b2a54ed187 tempest-TestMinimumBasicScenario-1035681150 tempest-TestMinimumBasicScenario-1035681150-project] 10.222.0.18 "GET /compute/v2.1/servers/121c5ed1-7baf-4e1a-b849-1c17079ff674" status: 200 len: 1756 microversion: 2.1 time: 0.245386 Jun 24 16:40:26.674320 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 406/824] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:40:26 2022] GET /compute/v2.1/servers/121c5ed1-7baf-4e1a-b849-1c17079ff674 => generated 1756 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 16:40:27.169688 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-568cf4bf-7b3f-42ce-b0b8-65ab828483ce tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Calling method '>' {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:40:27.170302 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-568cf4bf-7b3f-42ce-b0b8-65ab828483ce tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] [instance: bbc30718-1530-42df-bb08-c3418a02180f] Fetching instance by UUID {{(pid=102148) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:40:27.178629 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-568cf4bf-7b3f-42ce-b0b8-65ab828483ce tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:40:27.179110 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-568cf4bf-7b3f-42ce-b0b8-65ab828483ce tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:40:27.179898 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-568cf4bf-7b3f-42ce-b0b8-65ab828483ce tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:40:27.180336 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-568cf4bf-7b3f-42ce-b0b8-65ab828483ce tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:40:27.243825 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-bb792c24-7d0c-4b90-bac2-b6c0f6777efc tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Calling method '>' {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:40:27.244461 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-bb792c24-7d0c-4b90-bac2-b6c0f6777efc tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] [instance: 45111d6d-035d-465f-8cd8-aaebebeca3e7] Fetching instance by UUID {{(pid=102149) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:40:27.253629 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-bb792c24-7d0c-4b90-bac2-b6c0f6777efc tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:40:27.254089 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-bb792c24-7d0c-4b90-bac2-b6c0f6777efc tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:40:27.254940 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-bb792c24-7d0c-4b90-bac2-b6c0f6777efc tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:40:27.255383 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-bb792c24-7d0c-4b90-bac2-b6c0f6777efc tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:40:27.601102 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-bb792c24-7d0c-4b90-bac2-b6c0f6777efc tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65d11cab328748d5a8f5e55eb439e334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901fbc33d59d49f8afa7f06d62e19e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:40:27.616187 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-bb792c24-7d0c-4b90-bac2-b6c0f6777efc tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] 10.222.0.18 "GET /compute/v2.1/servers/45111d6d-035d-465f-8cd8-aaebebeca3e7" status: 200 len: 1266 microversion: 2.1 time: 0.373028 Jun 24 16:40:27.616187 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 407/825] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:40:27 2022] GET /compute/v2.1/servers/45111d6d-035d-465f-8cd8-aaebebeca3e7 => generated 1266 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 16:40:27.665761 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-568cf4bf-7b3f-42ce-b0b8-65ab828483ce tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5ba17c9390249878062ee1b003e9d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b03d0f5f955c49f48e6f06aaa5aae5f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:40:27.678659 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-568cf4bf-7b3f-42ce-b0b8-65ab828483ce tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] 10.222.0.18 "GET /compute/v2.1/servers/bbc30718-1530-42df-bb08-c3418a02180f" status: 200 len: 1361 microversion: 2.1 time: 0.512544 Jun 24 16:40:27.679556 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 419/826] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:40:27 2022] GET /compute/v2.1/servers/bbc30718-1530-42df-bb08-c3418a02180f => generated 1361 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 16:40:27.692430 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-82c7aab5-27b9-45dc-b396-0b804e49aaa8 tempest-TestMinimumBasicScenario-1035681150 tempest-TestMinimumBasicScenario-1035681150-project] Calling method '>' {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:40:27.693199 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-82c7aab5-27b9-45dc-b396-0b804e49aaa8 tempest-TestMinimumBasicScenario-1035681150 tempest-TestMinimumBasicScenario-1035681150-project] [instance: 121c5ed1-7baf-4e1a-b849-1c17079ff674] Fetching instance by UUID {{(pid=102149) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:40:27.700908 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-82c7aab5-27b9-45dc-b396-0b804e49aaa8 tempest-TestMinimumBasicScenario-1035681150 tempest-TestMinimumBasicScenario-1035681150-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:40:27.701943 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-82c7aab5-27b9-45dc-b396-0b804e49aaa8 tempest-TestMinimumBasicScenario-1035681150 tempest-TestMinimumBasicScenario-1035681150-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:40:27.702148 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-82c7aab5-27b9-45dc-b396-0b804e49aaa8 tempest-TestMinimumBasicScenario-1035681150 tempest-TestMinimumBasicScenario-1035681150-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:40:27.702585 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-82c7aab5-27b9-45dc-b396-0b804e49aaa8 tempest-TestMinimumBasicScenario-1035681150 tempest-TestMinimumBasicScenario-1035681150-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:40:27.915764 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-82c7aab5-27b9-45dc-b396-0b804e49aaa8 tempest-TestMinimumBasicScenario-1035681150 tempest-TestMinimumBasicScenario-1035681150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f875e9c85597441fb83cb9be8ddf91c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2df211bdae44be6b7e0cc41c2cd11e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:40:27.925195 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-82c7aab5-27b9-45dc-b396-0b804e49aaa8 tempest-TestMinimumBasicScenario-1035681150 tempest-TestMinimumBasicScenario-1035681150-project] 10.222.0.18 "GET /compute/v2.1/servers/121c5ed1-7baf-4e1a-b849-1c17079ff674" status: 200 len: 1756 microversion: 2.1 time: 0.237617 Jun 24 16:40:27.925763 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 408/827] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:40:27 2022] GET /compute/v2.1/servers/121c5ed1-7baf-4e1a-b849-1c17079ff674 => generated 1756 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 16:40:28.638863 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-60f8fec1-19a9-4e9a-ace7-0e97354bbdae tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Calling method '>' {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:40:28.639475 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-60f8fec1-19a9-4e9a-ace7-0e97354bbdae tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] [instance: 45111d6d-035d-465f-8cd8-aaebebeca3e7] Fetching instance by UUID {{(pid=102148) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:40:28.647341 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-60f8fec1-19a9-4e9a-ace7-0e97354bbdae tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:40:28.647713 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-60f8fec1-19a9-4e9a-ace7-0e97354bbdae tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:40:28.648843 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-60f8fec1-19a9-4e9a-ace7-0e97354bbdae tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:40:28.649275 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-60f8fec1-19a9-4e9a-ace7-0e97354bbdae tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:40:28.697138 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-fb48b740-49f9-4948-ad75-d1f091061f14 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Calling method '>' {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:40:28.698388 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-fb48b740-49f9-4948-ad75-d1f091061f14 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] [instance: bbc30718-1530-42df-bb08-c3418a02180f] Fetching instance by UUID {{(pid=102149) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:40:28.707816 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-fb48b740-49f9-4948-ad75-d1f091061f14 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:40:28.708382 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-fb48b740-49f9-4948-ad75-d1f091061f14 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:40:28.709378 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-fb48b740-49f9-4948-ad75-d1f091061f14 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:40:28.710103 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-fb48b740-49f9-4948-ad75-d1f091061f14 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:40:28.983012 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-60f8fec1-19a9-4e9a-ace7-0e97354bbdae tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65d11cab328748d5a8f5e55eb439e334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901fbc33d59d49f8afa7f06d62e19e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:40:28.992894 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-60f8fec1-19a9-4e9a-ace7-0e97354bbdae tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] 10.222.0.18 "GET /compute/v2.1/servers/45111d6d-035d-465f-8cd8-aaebebeca3e7" status: 200 len: 1266 microversion: 2.1 time: 0.357555 Jun 24 16:40:28.993457 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 420/828] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:40:28 2022] GET /compute/v2.1/servers/45111d6d-035d-465f-8cd8-aaebebeca3e7 => generated 1266 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 16:40:28.997761 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-26cb3fa4-9e5a-42be-ac26-7427d4bb3d81 tempest-TestMinimumBasicScenario-1035681150 tempest-TestMinimumBasicScenario-1035681150-project] Calling method '>' {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:40:29.001291 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-fb48b740-49f9-4948-ad75-d1f091061f14 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5ba17c9390249878062ee1b003e9d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b03d0f5f955c49f48e6f06aaa5aae5f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:40:29.006098 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-26cb3fa4-9e5a-42be-ac26-7427d4bb3d81 tempest-TestMinimumBasicScenario-1035681150 tempest-TestMinimumBasicScenario-1035681150-project] [instance: 121c5ed1-7baf-4e1a-b849-1c17079ff674] Fetching instance by UUID {{(pid=102148) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:40:29.012366 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-fb48b740-49f9-4948-ad75-d1f091061f14 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] 10.222.0.18 "GET /compute/v2.1/servers/bbc30718-1530-42df-bb08-c3418a02180f" status: 200 len: 1361 microversion: 2.1 time: 0.319548 Jun 24 16:40:29.013550 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 409/829] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:40:28 2022] GET /compute/v2.1/servers/bbc30718-1530-42df-bb08-c3418a02180f => generated 1361 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 16:40:29.013941 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-26cb3fa4-9e5a-42be-ac26-7427d4bb3d81 tempest-TestMinimumBasicScenario-1035681150 tempest-TestMinimumBasicScenario-1035681150-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:40:29.014410 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-26cb3fa4-9e5a-42be-ac26-7427d4bb3d81 tempest-TestMinimumBasicScenario-1035681150 tempest-TestMinimumBasicScenario-1035681150-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:40:29.015256 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-26cb3fa4-9e5a-42be-ac26-7427d4bb3d81 tempest-TestMinimumBasicScenario-1035681150 tempest-TestMinimumBasicScenario-1035681150-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:40:29.015901 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-26cb3fa4-9e5a-42be-ac26-7427d4bb3d81 tempest-TestMinimumBasicScenario-1035681150 tempest-TestMinimumBasicScenario-1035681150-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:40:29.352275 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-26cb3fa4-9e5a-42be-ac26-7427d4bb3d81 tempest-TestMinimumBasicScenario-1035681150 tempest-TestMinimumBasicScenario-1035681150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f875e9c85597441fb83cb9be8ddf91c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2df211bdae44be6b7e0cc41c2cd11e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:40:29.362242 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-26cb3fa4-9e5a-42be-ac26-7427d4bb3d81 tempest-TestMinimumBasicScenario-1035681150 tempest-TestMinimumBasicScenario-1035681150-project] 10.222.0.18 "GET /compute/v2.1/servers/121c5ed1-7baf-4e1a-b849-1c17079ff674" status: 200 len: 1759 microversion: 2.1 time: 0.367698 Jun 24 16:40:29.362984 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 421/830] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:40:28 2022] GET /compute/v2.1/servers/121c5ed1-7baf-4e1a-b849-1c17079ff674 => generated 1759 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 16:40:30.015957 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-dc30f0dd-a0a9-4621-babc-fea03e0a99cd tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Calling method '>' {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:40:30.017234 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-dc30f0dd-a0a9-4621-babc-fea03e0a99cd tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] [instance: 45111d6d-035d-465f-8cd8-aaebebeca3e7] Fetching instance by UUID {{(pid=102149) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:40:30.030741 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-dc30f0dd-a0a9-4621-babc-fea03e0a99cd tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:40:30.031906 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-dc30f0dd-a0a9-4621-babc-fea03e0a99cd tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:40:30.033011 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-8d9a11e4-d1dd-4928-87be-4c3eee9d44b6 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Calling method '>' {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:40:30.033471 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-dc30f0dd-a0a9-4621-babc-fea03e0a99cd tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:40:30.033802 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-8d9a11e4-d1dd-4928-87be-4c3eee9d44b6 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] [instance: bbc30718-1530-42df-bb08-c3418a02180f] Fetching instance by UUID {{(pid=102148) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:40:30.033940 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-dc30f0dd-a0a9-4621-babc-fea03e0a99cd tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:40:30.048075 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-8d9a11e4-d1dd-4928-87be-4c3eee9d44b6 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:40:30.049077 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-8d9a11e4-d1dd-4928-87be-4c3eee9d44b6 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:40:30.050854 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-8d9a11e4-d1dd-4928-87be-4c3eee9d44b6 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:40:30.051504 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-8d9a11e4-d1dd-4928-87be-4c3eee9d44b6 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:40:30.346382 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-dc30f0dd-a0a9-4621-babc-fea03e0a99cd tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65d11cab328748d5a8f5e55eb439e334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901fbc33d59d49f8afa7f06d62e19e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:40:30.353013 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-8d9a11e4-d1dd-4928-87be-4c3eee9d44b6 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5ba17c9390249878062ee1b003e9d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b03d0f5f955c49f48e6f06aaa5aae5f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:40:30.355425 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-dc30f0dd-a0a9-4621-babc-fea03e0a99cd tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] 10.222.0.18 "GET /compute/v2.1/servers/45111d6d-035d-465f-8cd8-aaebebeca3e7" status: 200 len: 1266 microversion: 2.1 time: 0.348229 Jun 24 16:40:30.366270 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 410/831] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:40:30 2022] GET /compute/v2.1/servers/45111d6d-035d-465f-8cd8-aaebebeca3e7 => generated 1266 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 16:40:30.375545 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-8d9a11e4-d1dd-4928-87be-4c3eee9d44b6 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] 10.222.0.18 "GET /compute/v2.1/servers/bbc30718-1530-42df-bb08-c3418a02180f" status: 200 len: 1361 microversion: 2.1 time: 0.348612 Jun 24 16:40:30.376488 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 422/832] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:40:30 2022] GET /compute/v2.1/servers/bbc30718-1530-42df-bb08-c3418a02180f => generated 1361 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 16:40:30.834716 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [req-6c7f8eea-c87f-4b85-9027-82621564ef33 req-d4995dbf-2132-437c-9e3e-e9f7591d3f46 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bbc30718-1530-42df-bb08-c3418a02180f", "name": "network-vif-plugged", "status": "completed", "tag": "42daa041-fdc0-4dfb-bf9b-d0e86576ac6d"}]} {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 16:40:30.836439 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 24 16:40:30.836439 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: warnings.warn(msg) Jun 24 16:40:30.844870 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [req-6c7f8eea-c87f-4b85-9027-82621564ef33 req-d4995dbf-2132-437c-9e3e-e9f7591d3f46 service nova] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:40:30.845349 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [req-6c7f8eea-c87f-4b85-9027-82621564ef33 req-d4995dbf-2132-437c-9e3e-e9f7591d3f46 service nova] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:40:30.861496 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.compute.server_external_events [req-6c7f8eea-c87f-4b85-9027-82621564ef33 req-d4995dbf-2132-437c-9e3e-e9f7591d3f46 service nova] Creating event network-vif-plugged:42daa041-fdc0-4dfb-bf9b-d0e86576ac6d for instance bbc30718-1530-42df-bb08-c3418a02180f on hv-cinder-84718 Jun 24 16:40:30.866102 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [req-6c7f8eea-c87f-4b85-9027-82621564ef33 req-d4995dbf-2132-437c-9e3e-e9f7591d3f46 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035028 Jun 24 16:40:30.866762 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 411/833] 10.222.0.18 () {64 vars in 1317 bytes} [Fri Jun 24 16:40:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 16:40:31.373290 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-a9575558-76bd-498c-a9f3-96ace2f60543 tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Calling method '>' {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:40:31.373902 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-a9575558-76bd-498c-a9f3-96ace2f60543 tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] [instance: 45111d6d-035d-465f-8cd8-aaebebeca3e7] Fetching instance by UUID {{(pid=102148) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:40:31.381365 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-a9575558-76bd-498c-a9f3-96ace2f60543 tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:40:31.381774 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-a9575558-76bd-498c-a9f3-96ace2f60543 tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:40:31.382540 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-a9575558-76bd-498c-a9f3-96ace2f60543 tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:40:31.383000 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-a9575558-76bd-498c-a9f3-96ace2f60543 tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:40:31.393336 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-bbea4f6b-611f-44c8-bded-5583f1c03d46 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Calling method '>' {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:40:31.394061 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-bbea4f6b-611f-44c8-bded-5583f1c03d46 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] [instance: bbc30718-1530-42df-bb08-c3418a02180f] Fetching instance by UUID {{(pid=102149) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:40:31.401660 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-bbea4f6b-611f-44c8-bded-5583f1c03d46 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:40:31.402112 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-bbea4f6b-611f-44c8-bded-5583f1c03d46 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:40:31.402912 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-bbea4f6b-611f-44c8-bded-5583f1c03d46 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:40:31.403346 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-bbea4f6b-611f-44c8-bded-5583f1c03d46 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:40:31.685825 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-a9575558-76bd-498c-a9f3-96ace2f60543 tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65d11cab328748d5a8f5e55eb439e334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901fbc33d59d49f8afa7f06d62e19e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:40:31.692864 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-bbea4f6b-611f-44c8-bded-5583f1c03d46 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5ba17c9390249878062ee1b003e9d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b03d0f5f955c49f48e6f06aaa5aae5f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:40:31.694384 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-a9575558-76bd-498c-a9f3-96ace2f60543 tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] 10.222.0.18 "GET /compute/v2.1/servers/45111d6d-035d-465f-8cd8-aaebebeca3e7" status: 200 len: 1266 microversion: 2.1 time: 0.324671 Jun 24 16:40:31.694982 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 423/834] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:40:31 2022] GET /compute/v2.1/servers/45111d6d-035d-465f-8cd8-aaebebeca3e7 => generated 1266 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 16:40:31.701406 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-bbea4f6b-611f-44c8-bded-5583f1c03d46 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] 10.222.0.18 "GET /compute/v2.1/servers/bbc30718-1530-42df-bb08-c3418a02180f" status: 200 len: 1361 microversion: 2.1 time: 0.312098 Jun 24 16:40:31.701986 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 412/835] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:40:31 2022] GET /compute/v2.1/servers/bbc30718-1530-42df-bb08-c3418a02180f => generated 1361 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 16:40:32.714159 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-3c8f799d-7b44-4981-a04b-3db89103e178 tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Calling method '>' {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:40:32.714920 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-3c8f799d-7b44-4981-a04b-3db89103e178 tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] [instance: 45111d6d-035d-465f-8cd8-aaebebeca3e7] Fetching instance by UUID {{(pid=102148) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:40:32.719265 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-29cf7b17-d404-4fde-8dd6-8252b988af8c tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Calling method '>' {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:40:32.719874 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-29cf7b17-d404-4fde-8dd6-8252b988af8c tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] [instance: bbc30718-1530-42df-bb08-c3418a02180f] Fetching instance by UUID {{(pid=102149) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:40:32.724171 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-3c8f799d-7b44-4981-a04b-3db89103e178 tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:40:32.724863 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-3c8f799d-7b44-4981-a04b-3db89103e178 tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:40:32.725661 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-3c8f799d-7b44-4981-a04b-3db89103e178 tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:40:32.726091 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-3c8f799d-7b44-4981-a04b-3db89103e178 tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:40:32.739943 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-29cf7b17-d404-4fde-8dd6-8252b988af8c tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:40:32.740867 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-29cf7b17-d404-4fde-8dd6-8252b988af8c tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:40:32.741900 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-29cf7b17-d404-4fde-8dd6-8252b988af8c tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:40:32.742544 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-29cf7b17-d404-4fde-8dd6-8252b988af8c tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:40:33.057791 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-3c8f799d-7b44-4981-a04b-3db89103e178 tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65d11cab328748d5a8f5e55eb439e334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901fbc33d59d49f8afa7f06d62e19e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:40:33.062633 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-29cf7b17-d404-4fde-8dd6-8252b988af8c tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5ba17c9390249878062ee1b003e9d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b03d0f5f955c49f48e6f06aaa5aae5f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:40:33.066596 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-3c8f799d-7b44-4981-a04b-3db89103e178 tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] 10.222.0.18 "GET /compute/v2.1/servers/45111d6d-035d-465f-8cd8-aaebebeca3e7" status: 200 len: 1266 microversion: 2.1 time: 0.357598 Jun 24 16:40:33.067188 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 424/836] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:40:32 2022] GET /compute/v2.1/servers/45111d6d-035d-465f-8cd8-aaebebeca3e7 => generated 1266 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 16:40:33.071579 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [req-a0756128-ecd6-4907-8e8f-9a1a76787854 req-8a5f08ae-d78b-429b-b257-b1dea37b25b9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "45111d6d-035d-465f-8cd8-aaebebeca3e7", "name": "network-vif-plugged", "status": "completed", "tag": "5ca97655-924b-4e05-814b-f5434e316687"}]} {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 16:40:33.071721 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-29cf7b17-d404-4fde-8dd6-8252b988af8c tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] 10.222.0.18 "GET /compute/v2.1/servers/bbc30718-1530-42df-bb08-c3418a02180f" status: 200 len: 1361 microversion: 2.1 time: 0.356444 Jun 24 16:40:33.072292 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 413/837] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:40:32 2022] GET /compute/v2.1/servers/bbc30718-1530-42df-bb08-c3418a02180f => generated 1361 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 16:40:33.073349 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 24 16:40:33.073349 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: warnings.warn(msg) Jun 24 16:40:33.082571 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [req-a0756128-ecd6-4907-8e8f-9a1a76787854 req-8a5f08ae-d78b-429b-b257-b1dea37b25b9 service nova] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:40:33.083043 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [req-a0756128-ecd6-4907-8e8f-9a1a76787854 req-8a5f08ae-d78b-429b-b257-b1dea37b25b9 service nova] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:40:33.098149 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.compute.server_external_events [req-a0756128-ecd6-4907-8e8f-9a1a76787854 req-8a5f08ae-d78b-429b-b257-b1dea37b25b9 service nova] Creating event network-vif-plugged:5ca97655-924b-4e05-814b-f5434e316687 for instance 45111d6d-035d-465f-8cd8-aaebebeca3e7 on hv-cinder-84718 Jun 24 16:40:33.103052 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [req-a0756128-ecd6-4907-8e8f-9a1a76787854 req-8a5f08ae-d78b-429b-b257-b1dea37b25b9 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034738 Jun 24 16:40:33.103606 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 425/838] 10.222.0.18 () {64 vars in 1317 bytes} [Fri Jun 24 16:40:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 16:40:34.084892 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-d6c53fef-cdcb-4e78-8eb2-7fa1354ba948 tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Calling method '>' {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:40:34.085633 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-d6c53fef-cdcb-4e78-8eb2-7fa1354ba948 tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] [instance: 45111d6d-035d-465f-8cd8-aaebebeca3e7] Fetching instance by UUID {{(pid=102149) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:40:34.089395 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-ee046197-2d12-4c5e-8abe-d1fcb401ebc3 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Calling method '>' {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:40:34.090094 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-ee046197-2d12-4c5e-8abe-d1fcb401ebc3 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] [instance: bbc30718-1530-42df-bb08-c3418a02180f] Fetching instance by UUID {{(pid=102148) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:40:34.093200 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-d6c53fef-cdcb-4e78-8eb2-7fa1354ba948 tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:40:34.094787 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-d6c53fef-cdcb-4e78-8eb2-7fa1354ba948 tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:40:34.095167 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-d6c53fef-cdcb-4e78-8eb2-7fa1354ba948 tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:40:34.095670 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-d6c53fef-cdcb-4e78-8eb2-7fa1354ba948 tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:40:34.098527 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-ee046197-2d12-4c5e-8abe-d1fcb401ebc3 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:40:34.099012 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-ee046197-2d12-4c5e-8abe-d1fcb401ebc3 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:40:34.099787 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-ee046197-2d12-4c5e-8abe-d1fcb401ebc3 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:40:34.100215 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-ee046197-2d12-4c5e-8abe-d1fcb401ebc3 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:40:34.417760 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-ee046197-2d12-4c5e-8abe-d1fcb401ebc3 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5ba17c9390249878062ee1b003e9d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b03d0f5f955c49f48e6f06aaa5aae5f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:40:34.420764 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-d6c53fef-cdcb-4e78-8eb2-7fa1354ba948 tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65d11cab328748d5a8f5e55eb439e334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901fbc33d59d49f8afa7f06d62e19e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:40:34.428848 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-ee046197-2d12-4c5e-8abe-d1fcb401ebc3 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] 10.222.0.18 "GET /compute/v2.1/servers/bbc30718-1530-42df-bb08-c3418a02180f" status: 200 len: 1547 microversion: 2.1 time: 0.343303 Jun 24 16:40:34.429428 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 426/839] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:40:34 2022] GET /compute/v2.1/servers/bbc30718-1530-42df-bb08-c3418a02180f => generated 1547 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 16:40:34.438871 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-d6c53fef-cdcb-4e78-8eb2-7fa1354ba948 tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] 10.222.0.18 "GET /compute/v2.1/servers/45111d6d-035d-465f-8cd8-aaebebeca3e7" status: 200 len: 1266 microversion: 2.1 time: 0.350795 Jun 24 16:40:34.438871 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 414/840] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:40:34 2022] GET /compute/v2.1/servers/45111d6d-035d-465f-8cd8-aaebebeca3e7 => generated 1266 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 16:40:34.446509 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-73d02408-1c0e-4813-a149-cdde4bc5b8fe tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Calling method '>' {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:40:34.447343 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-73d02408-1c0e-4813-a149-cdde4bc5b8fe tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] [instance: bbc30718-1530-42df-bb08-c3418a02180f] Fetching instance by UUID {{(pid=102149) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:40:34.456285 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-73d02408-1c0e-4813-a149-cdde4bc5b8fe tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:40:34.456633 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-73d02408-1c0e-4813-a149-cdde4bc5b8fe tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:40:34.457419 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-73d02408-1c0e-4813-a149-cdde4bc5b8fe tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:40:34.457855 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-73d02408-1c0e-4813-a149-cdde4bc5b8fe tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:40:34.620540 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-73d02408-1c0e-4813-a149-cdde4bc5b8fe tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] 10.222.0.18 "GET /compute/v2.1/servers/bbc30718-1530-42df-bb08-c3418a02180f/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.177924 Jun 24 16:40:34.621162 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 415/841] 10.222.0.18 () {58 vars in 1274 bytes} [Fri Jun 24 16:40:34 2022] GET /compute/v2.1/servers/bbc30718-1530-42df-bb08-c3418a02180f/os-interface => generated 285 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 16:40:35.449383 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-70030184-854f-437a-a0c5-acf375a50c3f tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Calling method '>' {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:40:35.449996 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-70030184-854f-437a-a0c5-acf375a50c3f tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] [instance: 45111d6d-035d-465f-8cd8-aaebebeca3e7] Fetching instance by UUID {{(pid=102148) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:40:35.458327 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-70030184-854f-437a-a0c5-acf375a50c3f tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:40:35.458814 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-70030184-854f-437a-a0c5-acf375a50c3f tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:40:35.459578 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-70030184-854f-437a-a0c5-acf375a50c3f tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:40:35.460010 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-70030184-854f-437a-a0c5-acf375a50c3f tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:40:35.662125 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-70030184-854f-437a-a0c5-acf375a50c3f tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65d11cab328748d5a8f5e55eb439e334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901fbc33d59d49f8afa7f06d62e19e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:40:35.671382 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-70030184-854f-437a-a0c5-acf375a50c3f tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] 10.222.0.18 "GET /compute/v2.1/servers/45111d6d-035d-465f-8cd8-aaebebeca3e7" status: 200 len: 1452 microversion: 2.1 time: 0.225716 Jun 24 16:40:35.671960 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 427/842] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:40:35 2022] GET /compute/v2.1/servers/45111d6d-035d-465f-8cd8-aaebebeca3e7 => generated 1452 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 16:40:35.687924 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-a732117f-2283-40c6-afdb-34461d9b9afe tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Calling method '>' {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:40:35.688561 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-a732117f-2283-40c6-afdb-34461d9b9afe tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] [instance: 45111d6d-035d-465f-8cd8-aaebebeca3e7] Fetching instance by UUID {{(pid=102149) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:40:35.695736 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-a732117f-2283-40c6-afdb-34461d9b9afe tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:40:35.696182 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-a732117f-2283-40c6-afdb-34461d9b9afe tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:40:35.697038 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-a732117f-2283-40c6-afdb-34461d9b9afe tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:40:35.697389 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-a732117f-2283-40c6-afdb-34461d9b9afe tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:40:35.900288 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-a732117f-2283-40c6-afdb-34461d9b9afe tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65d11cab328748d5a8f5e55eb439e334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901fbc33d59d49f8afa7f06d62e19e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:40:35.908442 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-a732117f-2283-40c6-afdb-34461d9b9afe tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] 10.222.0.18 "GET /compute/v2.1/servers/45111d6d-035d-465f-8cd8-aaebebeca3e7" status: 200 len: 1452 microversion: 2.1 time: 0.224746 Jun 24 16:40:35.909006 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 416/843] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:40:35 2022] GET /compute/v2.1/servers/45111d6d-035d-465f-8cd8-aaebebeca3e7 => generated 1452 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 16:40:36.154668 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [req-3fc152dc-3728-4c8b-8588-857f9e41b81a req-f9106794-119e-43e2-ae91-e6fe274e5512 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bbc30718-1530-42df-bb08-c3418a02180f", "tag": "42daa041-fdc0-4dfb-bf9b-d0e86576ac6d"}]} {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 16:40:36.156263 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 24 16:40:36.156263 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: warnings.warn(msg) Jun 24 16:40:36.164307 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [req-3fc152dc-3728-4c8b-8588-857f9e41b81a req-f9106794-119e-43e2-ae91-e6fe274e5512 service nova] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:40:36.164743 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [req-3fc152dc-3728-4c8b-8588-857f9e41b81a req-f9106794-119e-43e2-ae91-e6fe274e5512 service nova] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:40:36.181821 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.compute.server_external_events [req-3fc152dc-3728-4c8b-8588-857f9e41b81a req-f9106794-119e-43e2-ae91-e6fe274e5512 service nova] Creating event network-changed:42daa041-fdc0-4dfb-bf9b-d0e86576ac6d for instance bbc30718-1530-42df-bb08-c3418a02180f on hv-cinder-84718 Jun 24 16:40:36.187558 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [req-3fc152dc-3728-4c8b-8588-857f9e41b81a req-f9106794-119e-43e2-ae91-e6fe274e5512 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035571 Jun 24 16:40:36.188172 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 428/844] 10.222.0.18 () {64 vars in 1317 bytes} [Fri Jun 24 16:40:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 16:40:38.671000 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [req-95175441-4d1e-465c-9dfa-2708a75809a8 req-ac7e4b30-e5b4-4666-bc45-63873631895e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "45111d6d-035d-465f-8cd8-aaebebeca3e7", "tag": "5ca97655-924b-4e05-814b-f5434e316687"}]} {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 16:40:38.673314 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 24 16:40:38.673314 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: warnings.warn(msg) Jun 24 16:40:38.681559 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [req-95175441-4d1e-465c-9dfa-2708a75809a8 req-ac7e4b30-e5b4-4666-bc45-63873631895e service nova] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:40:38.682002 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [req-95175441-4d1e-465c-9dfa-2708a75809a8 req-ac7e4b30-e5b4-4666-bc45-63873631895e service nova] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:40:38.697286 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.compute.server_external_events [req-95175441-4d1e-465c-9dfa-2708a75809a8 req-ac7e4b30-e5b4-4666-bc45-63873631895e service nova] Creating event network-changed:5ca97655-924b-4e05-814b-f5434e316687 for instance 45111d6d-035d-465f-8cd8-aaebebeca3e7 on hv-cinder-84718 Jun 24 16:40:38.702069 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [req-95175441-4d1e-465c-9dfa-2708a75809a8 req-ac7e4b30-e5b4-4666-bc45-63873631895e service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034702 Jun 24 16:40:38.702669 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 417/845] 10.222.0.18 () {64 vars in 1317 bytes} [Fri Jun 24 16:40:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 16:41:20.324246 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-815e7ead-d935-4f7d-887c-b4c7a84dcb92 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Calling method '>' {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:41:20.324918 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-815e7ead-d935-4f7d-887c-b4c7a84dcb92 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] [instance: bbc30718-1530-42df-bb08-c3418a02180f] Fetching instance by UUID {{(pid=102148) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:41:20.333492 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-815e7ead-d935-4f7d-887c-b4c7a84dcb92 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:41:20.333943 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-815e7ead-d935-4f7d-887c-b4c7a84dcb92 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:41:20.334748 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-815e7ead-d935-4f7d-887c-b4c7a84dcb92 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:41:20.335190 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-815e7ead-d935-4f7d-887c-b4c7a84dcb92 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:41:20.394545 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-815e7ead-d935-4f7d-887c-b4c7a84dcb92 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] 10.222.0.18 "GET /compute/v2.1/servers/bbc30718-1530-42df-bb08-c3418a02180f/ips" status: 200 len: 146 microversion: 2.1 time: 0.075103 Jun 24 16:41:20.395152 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 429/846] 10.222.0.18 () {58 vars in 1247 bytes} [Fri Jun 24 16:41:20 2022] GET /compute/v2.1/servers/bbc30718-1530-42df-bb08-c3418a02180f/ips => generated 146 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 16:41:22.445622 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-7208ac3c-1f6e-49d1-96b1-de5eb561c9d0 tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] Calling method '>' {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:41:22.446290 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-7208ac3c-1f6e-49d1-96b1-de5eb561c9d0 tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] [instance: bd57f4a8-0078-4dde-ac34-901a40bc7b8e] Fetching instance by UUID {{(pid=102149) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:41:22.449685 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [req-acf9cfec-87f1-4671-80b3-de3ade76c26b req-98b21ca7-b0be-4cd6-8180-1c727f5f47f9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bd57f4a8-0078-4dde-ac34-901a40bc7b8e", "tag": "6d2412c6-1db3-4737-baaa-2744c29fbff8"}]} {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 16:41:22.451392 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 24 16:41:22.451392 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: warnings.warn(msg) Jun 24 16:41:22.455177 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-7208ac3c-1f6e-49d1-96b1-de5eb561c9d0 tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:41:22.455725 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-7208ac3c-1f6e-49d1-96b1-de5eb561c9d0 tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:41:22.457369 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-7208ac3c-1f6e-49d1-96b1-de5eb561c9d0 tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:41:22.458048 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-7208ac3c-1f6e-49d1-96b1-de5eb561c9d0 tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:41:22.461102 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [req-acf9cfec-87f1-4671-80b3-de3ade76c26b req-98b21ca7-b0be-4cd6-8180-1c727f5f47f9 service nova] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:41:22.461549 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [req-acf9cfec-87f1-4671-80b3-de3ade76c26b req-98b21ca7-b0be-4cd6-8180-1c727f5f47f9 service nova] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:41:22.478084 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.compute.server_external_events [req-acf9cfec-87f1-4671-80b3-de3ade76c26b req-98b21ca7-b0be-4cd6-8180-1c727f5f47f9 service nova] Creating event network-changed:6d2412c6-1db3-4737-baaa-2744c29fbff8 for instance bd57f4a8-0078-4dde-ac34-901a40bc7b8e on hv-cinder-84718 Jun 24 16:41:22.483575 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [req-acf9cfec-87f1-4671-80b3-de3ade76c26b req-98b21ca7-b0be-4cd6-8180-1c727f5f47f9 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040198 Jun 24 16:41:22.484267 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 430/847] 10.222.0.18 () {64 vars in 1317 bytes} [Fri Jun 24 16:41:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 16:41:22.520512 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-7208ac3c-1f6e-49d1-96b1-de5eb561c9d0 tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] [instance: bd57f4a8-0078-4dde-ac34-901a40bc7b8e] Going to try to terminate instance {{(pid=102149) delete /opt/stack/nova/nova/compute/api.py:2562}} Jun 24 16:41:22.642962 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-7208ac3c-1f6e-49d1-96b1-de5eb561c9d0 tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] 10.222.0.18 "DELETE /compute/v2.1/servers/bd57f4a8-0078-4dde-ac34-901a40bc7b8e" status: 204 len: 0 microversion: 2.1 time: 0.201330 Jun 24 16:41:22.643944 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 418/848] 10.222.0.18 () {58 vars in 1238 bytes} [Fri Jun 24 16:41:22 2022] DELETE /compute/v2.1/servers/bd57f4a8-0078-4dde-ac34-901a40bc7b8e => generated 0 bytes in 205 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 24 16:41:22.652840 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-e2770e05-f758-4755-bc84-b7a443bd2a21 tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] Calling method '>' {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:41:22.653541 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-e2770e05-f758-4755-bc84-b7a443bd2a21 tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] [instance: bd57f4a8-0078-4dde-ac34-901a40bc7b8e] Fetching instance by UUID {{(pid=102148) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:41:22.661258 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-e2770e05-f758-4755-bc84-b7a443bd2a21 tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:41:22.661704 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-e2770e05-f758-4755-bc84-b7a443bd2a21 tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:41:22.662480 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-e2770e05-f758-4755-bc84-b7a443bd2a21 tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:41:22.663066 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-e2770e05-f758-4755-bc84-b7a443bd2a21 tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:41:22.848478 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-54965a69-0afc-426f-aeff-f9765fca8b4e tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0133010f-62de-416f-bdaa-3172534bf07f"}} {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 16:41:22.849942 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-54965a69-0afc-426f-aeff-f9765fca8b4e tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] [instance: bbc30718-1530-42df-bb08-c3418a02180f] Fetching instance by UUID {{(pid=102149) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:41:22.858514 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-54965a69-0afc-426f-aeff-f9765fca8b4e tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:41:22.859022 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-54965a69-0afc-426f-aeff-f9765fca8b4e tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:41:22.859968 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-54965a69-0afc-426f-aeff-f9765fca8b4e tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:41:22.860675 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-54965a69-0afc-426f-aeff-f9765fca8b4e tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:41:22.928097 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 24 16:41:22.928689 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: Fri Jun 24 16:41:22 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/bbc30718-1530-42df-bb08-c3418a02180f/os-volume_attachments (ip 10.222.0.18) !!! Jun 24 16:41:23.073604 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-e2770e05-f758-4755-bc84-b7a443bd2a21 tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b823267a02a465192aadb5a1c5a3d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34b225f93234ca38c8d0c3d37ba0b8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:41:23.083408 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-e2770e05-f758-4755-bc84-b7a443bd2a21 tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] 10.222.0.18 "GET /compute/v2.1/servers/bd57f4a8-0078-4dde-ac34-901a40bc7b8e" status: 200 len: 1569 microversion: 2.1 time: 0.435013 Jun 24 16:41:23.083911 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 431/849] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:41:22 2022] GET /compute/v2.1/servers/bd57f4a8-0078-4dde-ac34-901a40bc7b8e => generated 1569 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 16:41:23.489068 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-54965a69-0afc-426f-aeff-f9765fca8b4e tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] 10.222.0.18 "POST /compute/v2.1/servers/bbc30718-1530-42df-bb08-c3418a02180f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.645558 Jun 24 16:41:23.489862 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 419/850] 10.222.0.18 () {60 vars in 1322 bytes} [Fri Jun 24 16:41:22 2022] POST /compute/v2.1/servers/bbc30718-1530-42df-bb08-c3418a02180f/os-volume_attachments => generated 194 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 16:41:24.101116 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-6f0fbbf8-999c-4ca6-841c-d4403838e752 tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] Calling method '>' {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:41:24.101747 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-6f0fbbf8-999c-4ca6-841c-d4403838e752 tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] [instance: bd57f4a8-0078-4dde-ac34-901a40bc7b8e] Fetching instance by UUID {{(pid=102148) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:41:24.109203 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-6f0fbbf8-999c-4ca6-841c-d4403838e752 tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:41:24.109576 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-6f0fbbf8-999c-4ca6-841c-d4403838e752 tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:41:24.110344 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-6f0fbbf8-999c-4ca6-841c-d4403838e752 tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:41:24.110802 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-6f0fbbf8-999c-4ca6-841c-d4403838e752 tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:41:24.322285 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-6f0fbbf8-999c-4ca6-841c-d4403838e752 tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b823267a02a465192aadb5a1c5a3d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34b225f93234ca38c8d0c3d37ba0b8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:41:24.331191 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-6f0fbbf8-999c-4ca6-841c-d4403838e752 tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] 10.222.0.18 "GET /compute/v2.1/servers/bd57f4a8-0078-4dde-ac34-901a40bc7b8e" status: 200 len: 1450 microversion: 2.1 time: 0.233817 Jun 24 16:41:24.331771 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 432/851] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:41:24 2022] GET /compute/v2.1/servers/bd57f4a8-0078-4dde-ac34-901a40bc7b8e => generated 1450 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 16:41:25.348963 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-83f9d52b-d583-4374-9612-68d3c05d047b tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] Calling method '>' {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:41:25.349957 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-83f9d52b-d583-4374-9612-68d3c05d047b tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] [instance: bd57f4a8-0078-4dde-ac34-901a40bc7b8e] Fetching instance by UUID {{(pid=102149) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:41:25.358904 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-83f9d52b-d583-4374-9612-68d3c05d047b tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:41:25.359499 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-83f9d52b-d583-4374-9612-68d3c05d047b tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:41:25.360533 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-83f9d52b-d583-4374-9612-68d3c05d047b tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:41:25.361064 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-83f9d52b-d583-4374-9612-68d3c05d047b tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:41:25.433904 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [req-eaf4c398-12ba-4518-9a1d-7253da3ba099 req-76000e47-cfe8-48b2-b20b-21bbae047a51 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bd57f4a8-0078-4dde-ac34-901a40bc7b8e", "name": "network-vif-deleted", "tag": "6d2412c6-1db3-4737-baaa-2744c29fbff8"}]} {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 16:41:25.440704 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 24 16:41:25.440704 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: warnings.warn(msg) Jun 24 16:41:25.449979 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [req-eaf4c398-12ba-4518-9a1d-7253da3ba099 req-76000e47-cfe8-48b2-b20b-21bbae047a51 service nova] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:41:25.450413 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [req-eaf4c398-12ba-4518-9a1d-7253da3ba099 req-76000e47-cfe8-48b2-b20b-21bbae047a51 service nova] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:41:25.469059 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.compute.server_external_events [req-eaf4c398-12ba-4518-9a1d-7253da3ba099 req-76000e47-cfe8-48b2-b20b-21bbae047a51 service nova] Creating event network-vif-deleted:6d2412c6-1db3-4737-baaa-2744c29fbff8 for instance bd57f4a8-0078-4dde-ac34-901a40bc7b8e on hv-cinder-84718 Jun 24 16:41:25.474251 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [req-eaf4c398-12ba-4518-9a1d-7253da3ba099 req-76000e47-cfe8-48b2-b20b-21bbae047a51 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043975 Jun 24 16:41:25.474870 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 433/852] 10.222.0.18 () {64 vars in 1317 bytes} [Fri Jun 24 16:41:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 16:41:25.502734 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-83f9d52b-d583-4374-9612-68d3c05d047b tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b823267a02a465192aadb5a1c5a3d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34b225f93234ca38c8d0c3d37ba0b8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:41:25.513745 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-83f9d52b-d583-4374-9612-68d3c05d047b tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] 10.222.0.18 "GET /compute/v2.1/servers/bd57f4a8-0078-4dde-ac34-901a40bc7b8e" status: 200 len: 1382 microversion: 2.1 time: 0.168827 Jun 24 16:41:25.514549 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 420/853] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:41:25 2022] GET /compute/v2.1/servers/bd57f4a8-0078-4dde-ac34-901a40bc7b8e => generated 1382 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 16:41:26.531583 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-184c5ab9-e55c-4587-96c4-62825b5279d2 tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] Calling method '>' {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:41:26.532221 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-184c5ab9-e55c-4587-96c4-62825b5279d2 tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] [instance: bd57f4a8-0078-4dde-ac34-901a40bc7b8e] Fetching instance by UUID {{(pid=102148) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:41:26.539698 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-184c5ab9-e55c-4587-96c4-62825b5279d2 tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:41:26.540145 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-184c5ab9-e55c-4587-96c4-62825b5279d2 tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:41:26.540905 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-184c5ab9-e55c-4587-96c4-62825b5279d2 tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:41:26.541337 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-184c5ab9-e55c-4587-96c4-62825b5279d2 tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:41:26.590984 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.wsgi [None req-184c5ab9-e55c-4587-96c4-62825b5279d2 tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] HTTP exception thrown: Instance bd57f4a8-0078-4dde-ac34-901a40bc7b8e could not be found. Jun 24 16:41:26.591590 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-184c5ab9-e55c-4587-96c4-62825b5279d2 tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] Returning 404 to user: Instance bd57f4a8-0078-4dde-ac34-901a40bc7b8e could not be found. {{(pid=102148) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jun 24 16:41:26.592420 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-184c5ab9-e55c-4587-96c4-62825b5279d2 tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] 10.222.0.18 "GET /compute/v2.1/servers/bd57f4a8-0078-4dde-ac34-901a40bc7b8e" status: 404 len: 111 microversion: 2.1 time: 0.065041 Jun 24 16:41:26.592975 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 434/854] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:41:26 2022] GET /compute/v2.1/servers/bd57f4a8-0078-4dde-ac34-901a40bc7b8e => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 16:41:26.800200 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-7a63c499-4783-4c75-add5-53ad8a8c0ecc tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] Calling method '.version_select at 0x7f1ae8086700>' {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:41:26.818616 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-7a63c499-4783-4c75-add5-53ad8a8c0ecc tempest-TestShelveInstance-1507275054 tempest-TestShelveInstance-1507275054-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-2130265802" status: 202 len: 0 microversion: 2.1 time: 0.023599 Jun 24 16:41:26.819368 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 421/855] 10.222.0.18 () {58 vars in 1253 bytes} [Fri Jun 24 16:41:26 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-2130265802 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 24 16:41:31.313883 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-7da04713-744c-4908-8b3d-08f91091e44a tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 16:41:31.322971 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-7da04713-744c-4908-8b3d-08f91091e44a tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:41:31.323707 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-7da04713-744c-4908-8b3d-08f91091e44a tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:41:31.391341 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-7da04713-744c-4908-8b3d-08f91091e44a tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] [instance: bbc30718-1530-42df-bb08-c3418a02180f] Going to try to stop instance {{(pid=102148) force_stop /opt/stack/nova/nova/compute/api.py:2602}} Jun 24 16:41:31.473790 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-7da04713-744c-4908-8b3d-08f91091e44a tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] 10.222.0.18 "POST /compute/v2.1/servers/bbc30718-1530-42df-bb08-c3418a02180f/action" status: 202 len: 0 microversion: 2.1 time: 0.163724 Jun 24 16:41:31.474787 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 435/856] 10.222.0.18 () {60 vars in 1277 bytes} [Fri Jun 24 16:41:31 2022] POST /compute/v2.1/servers/bbc30718-1530-42df-bb08-c3418a02180f/action => generated 0 bytes in 166 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 24 16:41:31.484818 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-8e987906-15de-4da4-b6eb-71cde4791f22 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Calling method '>' {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:41:31.486650 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-8e987906-15de-4da4-b6eb-71cde4791f22 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] [instance: bbc30718-1530-42df-bb08-c3418a02180f] Fetching instance by UUID {{(pid=102149) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:41:31.498907 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-8e987906-15de-4da4-b6eb-71cde4791f22 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:41:31.499629 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-8e987906-15de-4da4-b6eb-71cde4791f22 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:41:31.500412 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-8e987906-15de-4da4-b6eb-71cde4791f22 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:41:31.500843 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-8e987906-15de-4da4-b6eb-71cde4791f22 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:41:32.020378 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-8e987906-15de-4da4-b6eb-71cde4791f22 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5ba17c9390249878062ee1b003e9d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b03d0f5f955c49f48e6f06aaa5aae5f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:41:32.031992 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-8e987906-15de-4da4-b6eb-71cde4791f22 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] 10.222.0.18 "GET /compute/v2.1/servers/bbc30718-1530-42df-bb08-c3418a02180f" status: 200 len: 1722 microversion: 2.1 time: 0.552215 Jun 24 16:41:32.032846 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 422/857] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:41:31 2022] GET /compute/v2.1/servers/bbc30718-1530-42df-bb08-c3418a02180f => generated 1722 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 16:41:32.906742 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-72a39231-5327-4405-ad96-a130cd18c040 tempest-TestMinimumBasicScenario-1035681150 tempest-TestMinimumBasicScenario-1035681150-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-831328289"}} {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 16:41:32.907342 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-72a39231-5327-4405-ad96-a130cd18c040 tempest-TestMinimumBasicScenario-1035681150 tempest-TestMinimumBasicScenario-1035681150-project] [instance: 121c5ed1-7baf-4e1a-b849-1c17079ff674] Fetching instance by UUID {{(pid=102148) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:41:32.915553 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-72a39231-5327-4405-ad96-a130cd18c040 tempest-TestMinimumBasicScenario-1035681150 tempest-TestMinimumBasicScenario-1035681150-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:41:32.915991 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-72a39231-5327-4405-ad96-a130cd18c040 tempest-TestMinimumBasicScenario-1035681150 tempest-TestMinimumBasicScenario-1035681150-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:41:32.916755 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-72a39231-5327-4405-ad96-a130cd18c040 tempest-TestMinimumBasicScenario-1035681150 tempest-TestMinimumBasicScenario-1035681150-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:41:32.917180 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-72a39231-5327-4405-ad96-a130cd18c040 tempest-TestMinimumBasicScenario-1035681150 tempest-TestMinimumBasicScenario-1035681150-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:41:33.049184 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-dd24744c-b524-4e11-b899-cad7f38cef97 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Calling method '>' {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:41:33.049939 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-dd24744c-b524-4e11-b899-cad7f38cef97 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] [instance: bbc30718-1530-42df-bb08-c3418a02180f] Fetching instance by UUID {{(pid=102149) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:41:33.058992 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-dd24744c-b524-4e11-b899-cad7f38cef97 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:41:33.058992 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-dd24744c-b524-4e11-b899-cad7f38cef97 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:41:33.059700 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-dd24744c-b524-4e11-b899-cad7f38cef97 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:41:33.060138 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-dd24744c-b524-4e11-b899-cad7f38cef97 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:41:33.128015 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.network.security_group_api [None req-72a39231-5327-4405-ad96-a130cd18c040 tempest-TestMinimumBasicScenario-1035681150 tempest-TestMinimumBasicScenario-1035681150-project] Removing security group 3fe36388-f84c-489a-992f-b31b2e32a507 from port 688e29ea-2634-442c-8941-c7390b7f3cc6 Jun 24 16:41:33.463835 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-dd24744c-b524-4e11-b899-cad7f38cef97 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5ba17c9390249878062ee1b003e9d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b03d0f5f955c49f48e6f06aaa5aae5f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:41:33.473179 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-dd24744c-b524-4e11-b899-cad7f38cef97 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] 10.222.0.18 "GET /compute/v2.1/servers/bbc30718-1530-42df-bb08-c3418a02180f" status: 200 len: 1722 microversion: 2.1 time: 0.427676 Jun 24 16:41:33.473741 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 423/858] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:41:33 2022] GET /compute/v2.1/servers/bbc30718-1530-42df-bb08-c3418a02180f => generated 1722 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 16:41:33.750102 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-72a39231-5327-4405-ad96-a130cd18c040 tempest-TestMinimumBasicScenario-1035681150 tempest-TestMinimumBasicScenario-1035681150-project] 10.222.0.18 "POST /compute/v2.1/servers/121c5ed1-7baf-4e1a-b849-1c17079ff674/action" status: 202 len: 0 microversion: 2.1 time: 0.847574 Jun 24 16:41:33.755235 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 436/859] 10.222.0.18 () {60 vars in 1277 bytes} [Fri Jun 24 16:41:32 2022] POST /compute/v2.1/servers/121c5ed1-7baf-4e1a-b849-1c17079ff674/action => generated 0 bytes in 854 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 24 16:41:33.780529 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [req-ff8d853e-6d28-4938-84ff-dde961743bfe req-a61ec3c1-d1d6-4a33-a540-a13eb0c94e3d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "121c5ed1-7baf-4e1a-b849-1c17079ff674", "tag": "688e29ea-2634-442c-8941-c7390b7f3cc6"}]} {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 16:41:33.782497 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 24 16:41:33.782497 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: warnings.warn(msg) Jun 24 16:41:33.820726 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [req-ff8d853e-6d28-4938-84ff-dde961743bfe req-a61ec3c1-d1d6-4a33-a540-a13eb0c94e3d service nova] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:41:33.821296 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [req-ff8d853e-6d28-4938-84ff-dde961743bfe req-a61ec3c1-d1d6-4a33-a540-a13eb0c94e3d service nova] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:41:33.871326 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.compute.server_external_events [req-ff8d853e-6d28-4938-84ff-dde961743bfe req-a61ec3c1-d1d6-4a33-a540-a13eb0c94e3d service nova] Creating event network-changed:688e29ea-2634-442c-8941-c7390b7f3cc6 for instance 121c5ed1-7baf-4e1a-b849-1c17079ff674 on hv-cinder-84718 Jun 24 16:41:33.884591 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [req-ff8d853e-6d28-4938-84ff-dde961743bfe req-a61ec3c1-d1d6-4a33-a540-a13eb0c94e3d service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.109906 Jun 24 16:41:33.885113 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 424/860] 10.222.0.18 () {64 vars in 1317 bytes} [Fri Jun 24 16:41:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 16:41:34.492912 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-963b2789-1fb0-42e1-978e-fe6a47c447b7 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Calling method '>' {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:41:34.493784 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-963b2789-1fb0-42e1-978e-fe6a47c447b7 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] [instance: bbc30718-1530-42df-bb08-c3418a02180f] Fetching instance by UUID {{(pid=102148) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:41:34.502117 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-963b2789-1fb0-42e1-978e-fe6a47c447b7 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:41:34.502586 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-963b2789-1fb0-42e1-978e-fe6a47c447b7 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:41:34.503429 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-963b2789-1fb0-42e1-978e-fe6a47c447b7 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:41:34.503866 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-963b2789-1fb0-42e1-978e-fe6a47c447b7 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:41:34.927931 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-963b2789-1fb0-42e1-978e-fe6a47c447b7 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5ba17c9390249878062ee1b003e9d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b03d0f5f955c49f48e6f06aaa5aae5f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:41:34.937988 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-963b2789-1fb0-42e1-978e-fe6a47c447b7 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] 10.222.0.18 "GET /compute/v2.1/servers/bbc30718-1530-42df-bb08-c3418a02180f" status: 200 len: 1722 microversion: 2.1 time: 0.448390 Jun 24 16:41:34.938813 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 437/861] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:41:34 2022] GET /compute/v2.1/servers/bbc30718-1530-42df-bb08-c3418a02180f => generated 1722 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 16:41:35.956555 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-5b519c46-708b-45e4-a8c3-756a716af163 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Calling method '>' {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:41:35.957259 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-5b519c46-708b-45e4-a8c3-756a716af163 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] [instance: bbc30718-1530-42df-bb08-c3418a02180f] Fetching instance by UUID {{(pid=102149) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:41:35.965969 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-5b519c46-708b-45e4-a8c3-756a716af163 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:41:35.966325 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-5b519c46-708b-45e4-a8c3-756a716af163 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:41:35.967133 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-5b519c46-708b-45e4-a8c3-756a716af163 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:41:35.967854 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-5b519c46-708b-45e4-a8c3-756a716af163 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:41:36.600723 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-5b519c46-708b-45e4-a8c3-756a716af163 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5ba17c9390249878062ee1b003e9d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b03d0f5f955c49f48e6f06aaa5aae5f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:41:36.614468 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-5b519c46-708b-45e4-a8c3-756a716af163 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] 10.222.0.18 "GET /compute/v2.1/servers/bbc30718-1530-42df-bb08-c3418a02180f" status: 200 len: 1722 microversion: 2.1 time: 0.663069 Jun 24 16:41:36.630518 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-c446bc32-fd6d-4327-bb53-917745aa886e tempest-TestMinimumBasicScenario-1035681150 tempest-TestMinimumBasicScenario-1035681150-project] Calling method '>' {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:41:36.631658 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-c446bc32-fd6d-4327-bb53-917745aa886e tempest-TestMinimumBasicScenario-1035681150 tempest-TestMinimumBasicScenario-1035681150-project] [instance: 121c5ed1-7baf-4e1a-b849-1c17079ff674] Fetching instance by UUID {{(pid=102148) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:41:36.633176 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 425/862] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:41:35 2022] GET /compute/v2.1/servers/bbc30718-1530-42df-bb08-c3418a02180f => generated 1722 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 16:41:36.642970 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [req-896cfb6a-171f-4572-b9a4-3aa384a8d6db req-549ce53b-70ea-4d04-8f27-90a4bf718eae service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "121c5ed1-7baf-4e1a-b849-1c17079ff674", "tag": "688e29ea-2634-442c-8941-c7390b7f3cc6"}]} {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 16:41:36.643986 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-c446bc32-fd6d-4327-bb53-917745aa886e tempest-TestMinimumBasicScenario-1035681150 tempest-TestMinimumBasicScenario-1035681150-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:41:36.645220 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-c446bc32-fd6d-4327-bb53-917745aa886e tempest-TestMinimumBasicScenario-1035681150 tempest-TestMinimumBasicScenario-1035681150-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:41:36.646971 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 24 16:41:36.646971 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: warnings.warn(msg) Jun 24 16:41:36.647506 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-c446bc32-fd6d-4327-bb53-917745aa886e tempest-TestMinimumBasicScenario-1035681150 tempest-TestMinimumBasicScenario-1035681150-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:41:36.648053 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-c446bc32-fd6d-4327-bb53-917745aa886e tempest-TestMinimumBasicScenario-1035681150 tempest-TestMinimumBasicScenario-1035681150-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:41:36.660004 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [req-896cfb6a-171f-4572-b9a4-3aa384a8d6db req-549ce53b-70ea-4d04-8f27-90a4bf718eae service nova] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:41:36.660856 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [req-896cfb6a-171f-4572-b9a4-3aa384a8d6db req-549ce53b-70ea-4d04-8f27-90a4bf718eae service nova] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:41:36.700986 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.compute.server_external_events [req-896cfb6a-171f-4572-b9a4-3aa384a8d6db req-549ce53b-70ea-4d04-8f27-90a4bf718eae service nova] Creating event network-changed:688e29ea-2634-442c-8941-c7390b7f3cc6 for instance 121c5ed1-7baf-4e1a-b849-1c17079ff674 on hv-cinder-84718 Jun 24 16:41:36.708991 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [req-896cfb6a-171f-4572-b9a4-3aa384a8d6db req-549ce53b-70ea-4d04-8f27-90a4bf718eae service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072033 Jun 24 16:41:36.709970 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 426/863] 10.222.0.18 () {64 vars in 1317 bytes} [Fri Jun 24 16:41:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 16:41:36.854233 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.objects.instance [None req-c446bc32-fd6d-4327-bb53-917745aa886e tempest-TestMinimumBasicScenario-1035681150 tempest-TestMinimumBasicScenario-1035681150-project] Lazy-loading 'services' on Instance uuid 121c5ed1-7baf-4e1a-b849-1c17079ff674 {{(pid=102148) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Jun 24 16:41:37.022298 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-c446bc32-fd6d-4327-bb53-917745aa886e tempest-TestMinimumBasicScenario-1035681150 tempest-TestMinimumBasicScenario-1035681150-project] 10.222.0.18 "DELETE /compute/v2.1/servers/121c5ed1-7baf-4e1a-b849-1c17079ff674/os-volume_attachments/2b84aa23-9e31-4a4d-8c94-2471f5dd29fd" status: 202 len: 0 microversion: 2.1 time: 0.396160 Jun 24 16:41:37.023732 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 438/864] 10.222.0.18 () {58 vars in 1415 bytes} [Fri Jun 24 16:41:36 2022] DELETE /compute/v2.1/servers/121c5ed1-7baf-4e1a-b849-1c17079ff674/os-volume_attachments/2b84aa23-9e31-4a4d-8c94-2471f5dd29fd => generated 0 bytes in 399 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 24 16:41:37.034626 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-cc44f8e1-a2d8-4add-95d3-7a969f7ff61b tempest-TestMinimumBasicScenario-1035681150 tempest-TestMinimumBasicScenario-1035681150-project] Calling method '>' {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:41:37.035691 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-cc44f8e1-a2d8-4add-95d3-7a969f7ff61b tempest-TestMinimumBasicScenario-1035681150 tempest-TestMinimumBasicScenario-1035681150-project] [instance: 121c5ed1-7baf-4e1a-b849-1c17079ff674] Fetching instance by UUID {{(pid=102149) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:41:37.053190 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-cc44f8e1-a2d8-4add-95d3-7a969f7ff61b tempest-TestMinimumBasicScenario-1035681150 tempest-TestMinimumBasicScenario-1035681150-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:41:37.054146 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-cc44f8e1-a2d8-4add-95d3-7a969f7ff61b tempest-TestMinimumBasicScenario-1035681150 tempest-TestMinimumBasicScenario-1035681150-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:41:37.055152 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-cc44f8e1-a2d8-4add-95d3-7a969f7ff61b tempest-TestMinimumBasicScenario-1035681150 tempest-TestMinimumBasicScenario-1035681150-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:41:37.055750 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-cc44f8e1-a2d8-4add-95d3-7a969f7ff61b tempest-TestMinimumBasicScenario-1035681150 tempest-TestMinimumBasicScenario-1035681150-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:41:37.172585 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-cc44f8e1-a2d8-4add-95d3-7a969f7ff61b tempest-TestMinimumBasicScenario-1035681150 tempest-TestMinimumBasicScenario-1035681150-project] 10.222.0.18 "GET /compute/v2.1/servers/121c5ed1-7baf-4e1a-b849-1c17079ff674/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.144572 Jun 24 16:41:37.173173 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 427/865] 10.222.0.18 () {58 vars in 1301 bytes} [Fri Jun 24 16:41:37 2022] GET /compute/v2.1/servers/121c5ed1-7baf-4e1a-b849-1c17079ff674/os-volume_attachments => generated 197 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 16:41:37.633047 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-ae3216f7-0105-49ec-bb35-8bf3cb918d77 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Calling method '>' {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:41:37.634404 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-ae3216f7-0105-49ec-bb35-8bf3cb918d77 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] [instance: bbc30718-1530-42df-bb08-c3418a02180f] Fetching instance by UUID {{(pid=102148) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:41:37.654158 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-ae3216f7-0105-49ec-bb35-8bf3cb918d77 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:41:37.654607 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-ae3216f7-0105-49ec-bb35-8bf3cb918d77 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:41:37.655424 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-ae3216f7-0105-49ec-bb35-8bf3cb918d77 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:41:37.655855 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-ae3216f7-0105-49ec-bb35-8bf3cb918d77 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:41:38.095221 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-ae3216f7-0105-49ec-bb35-8bf3cb918d77 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5ba17c9390249878062ee1b003e9d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b03d0f5f955c49f48e6f06aaa5aae5f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:41:38.104111 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-ae3216f7-0105-49ec-bb35-8bf3cb918d77 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] 10.222.0.18 "GET /compute/v2.1/servers/bbc30718-1530-42df-bb08-c3418a02180f" status: 200 len: 1722 microversion: 2.1 time: 0.475704 Jun 24 16:41:38.114598 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 439/866] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:41:37 2022] GET /compute/v2.1/servers/bbc30718-1530-42df-bb08-c3418a02180f => generated 1722 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 16:41:38.185213 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-666caa4d-8b24-45ef-8593-7a5341e7be18 tempest-TestMinimumBasicScenario-1035681150 tempest-TestMinimumBasicScenario-1035681150-project] Calling method '>' {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:41:38.186859 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-666caa4d-8b24-45ef-8593-7a5341e7be18 tempest-TestMinimumBasicScenario-1035681150 tempest-TestMinimumBasicScenario-1035681150-project] [instance: 121c5ed1-7baf-4e1a-b849-1c17079ff674] Fetching instance by UUID {{(pid=102149) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:41:38.190246 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 24 16:41:38.190398 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: Fri Jun 24 16:41:38 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 24 16:41:38.197004 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-666caa4d-8b24-45ef-8593-7a5341e7be18 tempest-TestMinimumBasicScenario-1035681150 tempest-TestMinimumBasicScenario-1035681150-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:41:38.198408 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-666caa4d-8b24-45ef-8593-7a5341e7be18 tempest-TestMinimumBasicScenario-1035681150 tempest-TestMinimumBasicScenario-1035681150-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:41:38.199605 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-666caa4d-8b24-45ef-8593-7a5341e7be18 tempest-TestMinimumBasicScenario-1035681150 tempest-TestMinimumBasicScenario-1035681150-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:41:38.200215 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-666caa4d-8b24-45ef-8593-7a5341e7be18 tempest-TestMinimumBasicScenario-1035681150 tempest-TestMinimumBasicScenario-1035681150-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:41:38.280232 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-666caa4d-8b24-45ef-8593-7a5341e7be18 tempest-TestMinimumBasicScenario-1035681150 tempest-TestMinimumBasicScenario-1035681150-project] 10.222.0.18 "GET /compute/v2.1/servers/121c5ed1-7baf-4e1a-b849-1c17079ff674/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.099135 Jun 24 16:41:38.281042 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 428/867] 10.222.0.18 () {58 vars in 1301 bytes} [Fri Jun 24 16:41:38 2022] GET /compute/v2.1/servers/121c5ed1-7baf-4e1a-b849-1c17079ff674/os-volume_attachments => generated 25 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 24 16:41:38.291234 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-d303761e-0e48-4ff1-ae42-8d3a68be9d68 tempest-TestMinimumBasicScenario-1035681150 tempest-TestMinimumBasicScenario-1035681150-project] Calling method '>' {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:41:38.291920 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-d303761e-0e48-4ff1-ae42-8d3a68be9d68 tempest-TestMinimumBasicScenario-1035681150 tempest-TestMinimumBasicScenario-1035681150-project] [instance: 121c5ed1-7baf-4e1a-b849-1c17079ff674] Fetching instance by UUID {{(pid=102148) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:41:38.299976 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-d303761e-0e48-4ff1-ae42-8d3a68be9d68 tempest-TestMinimumBasicScenario-1035681150 tempest-TestMinimumBasicScenario-1035681150-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:41:38.300513 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-d303761e-0e48-4ff1-ae42-8d3a68be9d68 tempest-TestMinimumBasicScenario-1035681150 tempest-TestMinimumBasicScenario-1035681150-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:41:38.301653 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-d303761e-0e48-4ff1-ae42-8d3a68be9d68 tempest-TestMinimumBasicScenario-1035681150 tempest-TestMinimumBasicScenario-1035681150-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:41:38.302163 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-d303761e-0e48-4ff1-ae42-8d3a68be9d68 tempest-TestMinimumBasicScenario-1035681150 tempest-TestMinimumBasicScenario-1035681150-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:41:38.479773 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.wsgi [None req-d303761e-0e48-4ff1-ae42-8d3a68be9d68 tempest-TestMinimumBasicScenario-1035681150 tempest-TestMinimumBasicScenario-1035681150-project] HTTP exception thrown: Instance 121c5ed1-7baf-4e1a-b849-1c17079ff674 is not attached to volume 2b84aa23-9e31-4a4d-8c94-2471f5dd29fd Jun 24 16:41:38.480462 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-d303761e-0e48-4ff1-ae42-8d3a68be9d68 tempest-TestMinimumBasicScenario-1035681150 tempest-TestMinimumBasicScenario-1035681150-project] Returning 404 to user: Instance 121c5ed1-7baf-4e1a-b849-1c17079ff674 is not attached to volume 2b84aa23-9e31-4a4d-8c94-2471f5dd29fd {{(pid=102148) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jun 24 16:41:38.481371 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-d303761e-0e48-4ff1-ae42-8d3a68be9d68 tempest-TestMinimumBasicScenario-1035681150 tempest-TestMinimumBasicScenario-1035681150-project] 10.222.0.18 "DELETE /compute/v2.1/servers/121c5ed1-7baf-4e1a-b849-1c17079ff674/os-volume_attachments/2b84aa23-9e31-4a4d-8c94-2471f5dd29fd" status: 404 len: 154 microversion: 2.1 time: 0.194568 Jun 24 16:41:38.482453 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 440/868] 10.222.0.18 () {58 vars in 1415 bytes} [Fri Jun 24 16:41:38 2022] DELETE /compute/v2.1/servers/121c5ed1-7baf-4e1a-b849-1c17079ff674/os-volume_attachments/2b84aa23-9e31-4a4d-8c94-2471f5dd29fd => generated 154 bytes in 196 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 24 16:41:39.121328 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-e474427a-84d7-44a6-b23e-a8d034a30deb tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Calling method '>' {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:41:39.122178 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-e474427a-84d7-44a6-b23e-a8d034a30deb tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] [instance: bbc30718-1530-42df-bb08-c3418a02180f] Fetching instance by UUID {{(pid=102149) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:41:39.131067 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-e474427a-84d7-44a6-b23e-a8d034a30deb tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:41:39.131659 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-e474427a-84d7-44a6-b23e-a8d034a30deb tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:41:39.132544 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-e474427a-84d7-44a6-b23e-a8d034a30deb tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:41:39.133022 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-e474427a-84d7-44a6-b23e-a8d034a30deb tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:41:39.351402 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-e474427a-84d7-44a6-b23e-a8d034a30deb tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5ba17c9390249878062ee1b003e9d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b03d0f5f955c49f48e6f06aaa5aae5f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:41:39.360097 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-e474427a-84d7-44a6-b23e-a8d034a30deb tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] 10.222.0.18 "GET /compute/v2.1/servers/bbc30718-1530-42df-bb08-c3418a02180f" status: 200 len: 1722 microversion: 2.1 time: 0.242388 Jun 24 16:41:39.360953 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 429/869] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:41:39 2022] GET /compute/v2.1/servers/bbc30718-1530-42df-bb08-c3418a02180f => generated 1722 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 16:41:39.713427 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-6219af9a-492c-4b2f-8313-ced316057d68 tempest-TestMinimumBasicScenario-1035681150 tempest-TestMinimumBasicScenario-1035681150-project] Calling method '>' {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:41:39.713928 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-6219af9a-492c-4b2f-8313-ced316057d68 tempest-TestMinimumBasicScenario-1035681150 tempest-TestMinimumBasicScenario-1035681150-project] [instance: 121c5ed1-7baf-4e1a-b849-1c17079ff674] Fetching instance by UUID {{(pid=102148) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:41:39.722435 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-6219af9a-492c-4b2f-8313-ced316057d68 tempest-TestMinimumBasicScenario-1035681150 tempest-TestMinimumBasicScenario-1035681150-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:41:39.722882 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-6219af9a-492c-4b2f-8313-ced316057d68 tempest-TestMinimumBasicScenario-1035681150 tempest-TestMinimumBasicScenario-1035681150-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:41:39.723665 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-6219af9a-492c-4b2f-8313-ced316057d68 tempest-TestMinimumBasicScenario-1035681150 tempest-TestMinimumBasicScenario-1035681150-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:41:39.724074 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-6219af9a-492c-4b2f-8313-ced316057d68 tempest-TestMinimumBasicScenario-1035681150 tempest-TestMinimumBasicScenario-1035681150-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:41:39.788152 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-6219af9a-492c-4b2f-8313-ced316057d68 tempest-TestMinimumBasicScenario-1035681150 tempest-TestMinimumBasicScenario-1035681150-project] [instance: 121c5ed1-7baf-4e1a-b849-1c17079ff674] Going to try to terminate instance {{(pid=102148) delete /opt/stack/nova/nova/compute/api.py:2562}} Jun 24 16:41:39.910411 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-6219af9a-492c-4b2f-8313-ced316057d68 tempest-TestMinimumBasicScenario-1035681150 tempest-TestMinimumBasicScenario-1035681150-project] 10.222.0.18 "DELETE /compute/v2.1/servers/121c5ed1-7baf-4e1a-b849-1c17079ff674" status: 204 len: 0 microversion: 2.1 time: 0.200304 Jun 24 16:41:39.911228 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 441/870] 10.222.0.18 () {58 vars in 1238 bytes} [Fri Jun 24 16:41:39 2022] DELETE /compute/v2.1/servers/121c5ed1-7baf-4e1a-b849-1c17079ff674 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 24 16:41:39.921383 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-d9f43efb-b5d7-4452-8b10-0dab434d0e42 tempest-TestMinimumBasicScenario-1035681150 tempest-TestMinimumBasicScenario-1035681150-project] Calling method '>' {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:41:39.921982 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-d9f43efb-b5d7-4452-8b10-0dab434d0e42 tempest-TestMinimumBasicScenario-1035681150 tempest-TestMinimumBasicScenario-1035681150-project] [instance: 121c5ed1-7baf-4e1a-b849-1c17079ff674] Fetching instance by UUID {{(pid=102149) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:41:39.929534 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-d9f43efb-b5d7-4452-8b10-0dab434d0e42 tempest-TestMinimumBasicScenario-1035681150 tempest-TestMinimumBasicScenario-1035681150-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:41:39.929980 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-d9f43efb-b5d7-4452-8b10-0dab434d0e42 tempest-TestMinimumBasicScenario-1035681150 tempest-TestMinimumBasicScenario-1035681150-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:41:39.930764 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-d9f43efb-b5d7-4452-8b10-0dab434d0e42 tempest-TestMinimumBasicScenario-1035681150 tempest-TestMinimumBasicScenario-1035681150-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:41:39.931194 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-d9f43efb-b5d7-4452-8b10-0dab434d0e42 tempest-TestMinimumBasicScenario-1035681150 tempest-TestMinimumBasicScenario-1035681150-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:41:40.192745 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-d9f43efb-b5d7-4452-8b10-0dab434d0e42 tempest-TestMinimumBasicScenario-1035681150 tempest-TestMinimumBasicScenario-1035681150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f875e9c85597441fb83cb9be8ddf91c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2df211bdae44be6b7e0cc41c2cd11e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:41:40.200831 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-d9f43efb-b5d7-4452-8b10-0dab434d0e42 tempest-TestMinimumBasicScenario-1035681150 tempest-TestMinimumBasicScenario-1035681150-project] 10.222.0.18 "GET /compute/v2.1/servers/121c5ed1-7baf-4e1a-b849-1c17079ff674" status: 200 len: 1554 microversion: 2.1 time: 0.284890 Jun 24 16:41:40.201388 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 430/871] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:41:39 2022] GET /compute/v2.1/servers/121c5ed1-7baf-4e1a-b849-1c17079ff674 => generated 1554 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 16:41:40.378662 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-a82f6a09-8332-4089-ab5c-548f31048088 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Calling method '>' {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:41:40.379299 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-a82f6a09-8332-4089-ab5c-548f31048088 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] [instance: bbc30718-1530-42df-bb08-c3418a02180f] Fetching instance by UUID {{(pid=102148) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:41:40.386510 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-a82f6a09-8332-4089-ab5c-548f31048088 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:41:40.386989 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-a82f6a09-8332-4089-ab5c-548f31048088 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:41:40.387756 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-a82f6a09-8332-4089-ab5c-548f31048088 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:41:40.388183 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-a82f6a09-8332-4089-ab5c-548f31048088 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:41:40.591297 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-a82f6a09-8332-4089-ab5c-548f31048088 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5ba17c9390249878062ee1b003e9d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b03d0f5f955c49f48e6f06aaa5aae5f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:41:40.600743 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-a82f6a09-8332-4089-ab5c-548f31048088 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] 10.222.0.18 "GET /compute/v2.1/servers/bbc30718-1530-42df-bb08-c3418a02180f" status: 200 len: 1722 microversion: 2.1 time: 0.227129 Jun 24 16:41:40.601431 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 442/872] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:41:40 2022] GET /compute/v2.1/servers/bbc30718-1530-42df-bb08-c3418a02180f => generated 1722 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 16:41:41.218284 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-488866e0-cabc-4986-b027-71877759f9b6 tempest-TestMinimumBasicScenario-1035681150 tempest-TestMinimumBasicScenario-1035681150-project] Calling method '>' {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:41:41.218921 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-488866e0-cabc-4986-b027-71877759f9b6 tempest-TestMinimumBasicScenario-1035681150 tempest-TestMinimumBasicScenario-1035681150-project] [instance: 121c5ed1-7baf-4e1a-b849-1c17079ff674] Fetching instance by UUID {{(pid=102149) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:41:41.226764 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-488866e0-cabc-4986-b027-71877759f9b6 tempest-TestMinimumBasicScenario-1035681150 tempest-TestMinimumBasicScenario-1035681150-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:41:41.227206 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-488866e0-cabc-4986-b027-71877759f9b6 tempest-TestMinimumBasicScenario-1035681150 tempest-TestMinimumBasicScenario-1035681150-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:41:41.227963 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-488866e0-cabc-4986-b027-71877759f9b6 tempest-TestMinimumBasicScenario-1035681150 tempest-TestMinimumBasicScenario-1035681150-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:41:41.228388 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-488866e0-cabc-4986-b027-71877759f9b6 tempest-TestMinimumBasicScenario-1035681150 tempest-TestMinimumBasicScenario-1035681150-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:41:41.425306 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-488866e0-cabc-4986-b027-71877759f9b6 tempest-TestMinimumBasicScenario-1035681150 tempest-TestMinimumBasicScenario-1035681150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f875e9c85597441fb83cb9be8ddf91c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2df211bdae44be6b7e0cc41c2cd11e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:41:41.433499 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-488866e0-cabc-4986-b027-71877759f9b6 tempest-TestMinimumBasicScenario-1035681150 tempest-TestMinimumBasicScenario-1035681150-project] 10.222.0.18 "GET /compute/v2.1/servers/121c5ed1-7baf-4e1a-b849-1c17079ff674" status: 200 len: 1554 microversion: 2.1 time: 0.218926 Jun 24 16:41:41.434055 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 431/873] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:41:41 2022] GET /compute/v2.1/servers/121c5ed1-7baf-4e1a-b849-1c17079ff674 => generated 1554 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 16:41:41.617115 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-d42691ef-6dca-498e-b408-9188ec951267 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Calling method '>' {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:41:41.617722 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-d42691ef-6dca-498e-b408-9188ec951267 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] [instance: bbc30718-1530-42df-bb08-c3418a02180f] Fetching instance by UUID {{(pid=102148) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:41:41.624888 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-d42691ef-6dca-498e-b408-9188ec951267 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:41:41.625327 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-d42691ef-6dca-498e-b408-9188ec951267 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:41:41.626082 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-d42691ef-6dca-498e-b408-9188ec951267 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:41:41.627043 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-d42691ef-6dca-498e-b408-9188ec951267 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:41:41.827538 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-d42691ef-6dca-498e-b408-9188ec951267 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5ba17c9390249878062ee1b003e9d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b03d0f5f955c49f48e6f06aaa5aae5f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:41:41.837037 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-d42691ef-6dca-498e-b408-9188ec951267 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] 10.222.0.18 "GET /compute/v2.1/servers/bbc30718-1530-42df-bb08-c3418a02180f" status: 200 len: 1722 microversion: 2.1 time: 0.223686 Jun 24 16:41:41.837578 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 443/874] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:41:41 2022] GET /compute/v2.1/servers/bbc30718-1530-42df-bb08-c3418a02180f => generated 1722 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 16:41:42.450517 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-a6638532-47b1-4482-91d4-a31be0585c52 tempest-TestMinimumBasicScenario-1035681150 tempest-TestMinimumBasicScenario-1035681150-project] Calling method '>' {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:41:42.451165 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-a6638532-47b1-4482-91d4-a31be0585c52 tempest-TestMinimumBasicScenario-1035681150 tempest-TestMinimumBasicScenario-1035681150-project] [instance: 121c5ed1-7baf-4e1a-b849-1c17079ff674] Fetching instance by UUID {{(pid=102149) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:41:42.458829 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-a6638532-47b1-4482-91d4-a31be0585c52 tempest-TestMinimumBasicScenario-1035681150 tempest-TestMinimumBasicScenario-1035681150-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:41:42.459269 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-a6638532-47b1-4482-91d4-a31be0585c52 tempest-TestMinimumBasicScenario-1035681150 tempest-TestMinimumBasicScenario-1035681150-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:41:42.460031 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-a6638532-47b1-4482-91d4-a31be0585c52 tempest-TestMinimumBasicScenario-1035681150 tempest-TestMinimumBasicScenario-1035681150-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:41:42.460454 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-a6638532-47b1-4482-91d4-a31be0585c52 tempest-TestMinimumBasicScenario-1035681150 tempest-TestMinimumBasicScenario-1035681150-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:41:42.667591 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-a6638532-47b1-4482-91d4-a31be0585c52 tempest-TestMinimumBasicScenario-1035681150 tempest-TestMinimumBasicScenario-1035681150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f875e9c85597441fb83cb9be8ddf91c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2df211bdae44be6b7e0cc41c2cd11e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:41:42.675840 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-a6638532-47b1-4482-91d4-a31be0585c52 tempest-TestMinimumBasicScenario-1035681150 tempest-TestMinimumBasicScenario-1035681150-project] 10.222.0.18 "GET /compute/v2.1/servers/121c5ed1-7baf-4e1a-b849-1c17079ff674" status: 200 len: 1554 microversion: 2.1 time: 0.229076 Jun 24 16:41:42.676405 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 432/875] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:41:42 2022] GET /compute/v2.1/servers/121c5ed1-7baf-4e1a-b849-1c17079ff674 => generated 1554 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 16:41:42.853364 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-b5d521fa-3a7b-4110-82c0-b9b031a56b30 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Calling method '>' {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:41:42.853978 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-b5d521fa-3a7b-4110-82c0-b9b031a56b30 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] [instance: bbc30718-1530-42df-bb08-c3418a02180f] Fetching instance by UUID {{(pid=102148) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:41:42.861751 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-b5d521fa-3a7b-4110-82c0-b9b031a56b30 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:41:42.862253 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-b5d521fa-3a7b-4110-82c0-b9b031a56b30 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:41:42.863063 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-b5d521fa-3a7b-4110-82c0-b9b031a56b30 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:41:42.863499 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-b5d521fa-3a7b-4110-82c0-b9b031a56b30 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:41:42.925870 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [req-33f1c095-6e31-4cbd-8843-d7e1745c94d6 req-05983698-7263-4054-b1b8-0d0ea382686c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "121c5ed1-7baf-4e1a-b849-1c17079ff674", "name": "network-vif-deleted", "tag": "688e29ea-2634-442c-8941-c7390b7f3cc6"}]} {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 16:41:42.927458 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 24 16:41:42.927458 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: warnings.warn(msg) Jun 24 16:41:42.936212 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [req-33f1c095-6e31-4cbd-8843-d7e1745c94d6 req-05983698-7263-4054-b1b8-0d0ea382686c service nova] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:41:42.936650 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [req-33f1c095-6e31-4cbd-8843-d7e1745c94d6 req-05983698-7263-4054-b1b8-0d0ea382686c service nova] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:41:42.953177 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.compute.server_external_events [req-33f1c095-6e31-4cbd-8843-d7e1745c94d6 req-05983698-7263-4054-b1b8-0d0ea382686c service nova] Creating event network-vif-deleted:688e29ea-2634-442c-8941-c7390b7f3cc6 for instance 121c5ed1-7baf-4e1a-b849-1c17079ff674 on hv-cinder-84718 Jun 24 16:41:42.958521 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [req-33f1c095-6e31-4cbd-8843-d7e1745c94d6 req-05983698-7263-4054-b1b8-0d0ea382686c service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036789 Jun 24 16:41:42.959483 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 433/876] 10.222.0.18 () {64 vars in 1317 bytes} [Fri Jun 24 16:41:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 16:41:43.080549 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-b5d521fa-3a7b-4110-82c0-b9b031a56b30 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5ba17c9390249878062ee1b003e9d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b03d0f5f955c49f48e6f06aaa5aae5f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:41:43.090085 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-b5d521fa-3a7b-4110-82c0-b9b031a56b30 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] 10.222.0.18 "GET /compute/v2.1/servers/bbc30718-1530-42df-bb08-c3418a02180f" status: 200 len: 1722 microversion: 2.1 time: 0.240431 Jun 24 16:41:43.090681 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 444/877] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:41:42 2022] GET /compute/v2.1/servers/bbc30718-1530-42df-bb08-c3418a02180f => generated 1722 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 16:41:43.693263 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-f044d6d4-892a-4700-a0e5-c42452c2ae2c tempest-TestMinimumBasicScenario-1035681150 tempest-TestMinimumBasicScenario-1035681150-project] Calling method '>' {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:41:43.693952 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-f044d6d4-892a-4700-a0e5-c42452c2ae2c tempest-TestMinimumBasicScenario-1035681150 tempest-TestMinimumBasicScenario-1035681150-project] [instance: 121c5ed1-7baf-4e1a-b849-1c17079ff674] Fetching instance by UUID {{(pid=102149) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:41:43.701345 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-f044d6d4-892a-4700-a0e5-c42452c2ae2c tempest-TestMinimumBasicScenario-1035681150 tempest-TestMinimumBasicScenario-1035681150-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:41:43.701827 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-f044d6d4-892a-4700-a0e5-c42452c2ae2c tempest-TestMinimumBasicScenario-1035681150 tempest-TestMinimumBasicScenario-1035681150-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:41:43.702923 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-f044d6d4-892a-4700-a0e5-c42452c2ae2c tempest-TestMinimumBasicScenario-1035681150 tempest-TestMinimumBasicScenario-1035681150-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:41:43.703361 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-f044d6d4-892a-4700-a0e5-c42452c2ae2c tempest-TestMinimumBasicScenario-1035681150 tempest-TestMinimumBasicScenario-1035681150-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:41:43.759476 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.wsgi [None req-f044d6d4-892a-4700-a0e5-c42452c2ae2c tempest-TestMinimumBasicScenario-1035681150 tempest-TestMinimumBasicScenario-1035681150-project] HTTP exception thrown: Instance 121c5ed1-7baf-4e1a-b849-1c17079ff674 could not be found. Jun 24 16:41:43.760066 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-f044d6d4-892a-4700-a0e5-c42452c2ae2c tempest-TestMinimumBasicScenario-1035681150 tempest-TestMinimumBasicScenario-1035681150-project] Returning 404 to user: Instance 121c5ed1-7baf-4e1a-b849-1c17079ff674 could not be found. {{(pid=102149) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jun 24 16:41:43.760887 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-f044d6d4-892a-4700-a0e5-c42452c2ae2c tempest-TestMinimumBasicScenario-1035681150 tempest-TestMinimumBasicScenario-1035681150-project] 10.222.0.18 "GET /compute/v2.1/servers/121c5ed1-7baf-4e1a-b849-1c17079ff674" status: 404 len: 111 microversion: 2.1 time: 0.072390 Jun 24 16:41:43.761432 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 434/878] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:41:43 2022] GET /compute/v2.1/servers/121c5ed1-7baf-4e1a-b849-1c17079ff674 => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 16:41:43.769362 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-37be7061-1a71-4680-9659-82f2518d2263 tempest-TestMinimumBasicScenario-1035681150 tempest-TestMinimumBasicScenario-1035681150-project] Calling method '.version_select at 0x7f1ae83a3790>' {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:41:43.790427 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-37be7061-1a71-4680-9659-82f2518d2263 tempest-TestMinimumBasicScenario-1035681150 tempest-TestMinimumBasicScenario-1035681150-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1813564896" status: 202 len: 0 microversion: 2.1 time: 0.024579 Jun 24 16:41:43.791065 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 445/879] 10.222.0.18 () {58 vars in 1271 bytes} [Fri Jun 24 16:41:43 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1813564896 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 24 16:41:44.107188 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-aa6b5423-19b9-4d3a-ae28-95dae69d1586 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Calling method '>' {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:41:44.107974 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-aa6b5423-19b9-4d3a-ae28-95dae69d1586 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] [instance: bbc30718-1530-42df-bb08-c3418a02180f] Fetching instance by UUID {{(pid=102149) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:41:44.116578 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-aa6b5423-19b9-4d3a-ae28-95dae69d1586 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:41:44.117026 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-aa6b5423-19b9-4d3a-ae28-95dae69d1586 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:41:44.117803 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-aa6b5423-19b9-4d3a-ae28-95dae69d1586 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:41:44.118236 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-aa6b5423-19b9-4d3a-ae28-95dae69d1586 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:41:44.328842 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-aa6b5423-19b9-4d3a-ae28-95dae69d1586 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5ba17c9390249878062ee1b003e9d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b03d0f5f955c49f48e6f06aaa5aae5f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:41:44.338262 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-aa6b5423-19b9-4d3a-ae28-95dae69d1586 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] 10.222.0.18 "GET /compute/v2.1/servers/bbc30718-1530-42df-bb08-c3418a02180f" status: 200 len: 1722 microversion: 2.1 time: 0.235157 Jun 24 16:41:44.342828 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 435/880] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:41:44 2022] GET /compute/v2.1/servers/bbc30718-1530-42df-bb08-c3418a02180f => generated 1722 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 16:41:45.356236 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-e7d93df5-41ed-4310-8e37-6ab9ed52eca8 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Calling method '>' {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:41:45.357568 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-e7d93df5-41ed-4310-8e37-6ab9ed52eca8 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] [instance: bbc30718-1530-42df-bb08-c3418a02180f] Fetching instance by UUID {{(pid=102148) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:41:45.366158 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-e7d93df5-41ed-4310-8e37-6ab9ed52eca8 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:41:45.366610 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-e7d93df5-41ed-4310-8e37-6ab9ed52eca8 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:41:45.367488 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-e7d93df5-41ed-4310-8e37-6ab9ed52eca8 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:41:45.367933 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-e7d93df5-41ed-4310-8e37-6ab9ed52eca8 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:41:45.833170 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-e7d93df5-41ed-4310-8e37-6ab9ed52eca8 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5ba17c9390249878062ee1b003e9d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b03d0f5f955c49f48e6f06aaa5aae5f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:41:45.841651 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-e7d93df5-41ed-4310-8e37-6ab9ed52eca8 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] 10.222.0.18 "GET /compute/v2.1/servers/bbc30718-1530-42df-bb08-c3418a02180f" status: 200 len: 1722 microversion: 2.1 time: 0.489102 Jun 24 16:41:45.842211 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 446/881] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:41:45 2022] GET /compute/v2.1/servers/bbc30718-1530-42df-bb08-c3418a02180f => generated 1722 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 16:41:46.859402 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-1940bd0d-b3ac-4ad4-b3a4-014df1b4a0f3 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Calling method '>' {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:41:46.860147 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-1940bd0d-b3ac-4ad4-b3a4-014df1b4a0f3 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] [instance: bbc30718-1530-42df-bb08-c3418a02180f] Fetching instance by UUID {{(pid=102149) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:41:46.868053 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-1940bd0d-b3ac-4ad4-b3a4-014df1b4a0f3 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:41:46.868769 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-1940bd0d-b3ac-4ad4-b3a4-014df1b4a0f3 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:41:46.869550 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-1940bd0d-b3ac-4ad4-b3a4-014df1b4a0f3 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:41:46.869980 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-1940bd0d-b3ac-4ad4-b3a4-014df1b4a0f3 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:41:47.360518 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-1940bd0d-b3ac-4ad4-b3a4-014df1b4a0f3 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5ba17c9390249878062ee1b003e9d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b03d0f5f955c49f48e6f06aaa5aae5f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:41:47.375771 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-1940bd0d-b3ac-4ad4-b3a4-014df1b4a0f3 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] 10.222.0.18 "GET /compute/v2.1/servers/bbc30718-1530-42df-bb08-c3418a02180f" status: 200 len: 1722 microversion: 2.1 time: 0.519990 Jun 24 16:41:47.377370 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 436/882] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:41:46 2022] GET /compute/v2.1/servers/bbc30718-1530-42df-bb08-c3418a02180f => generated 1722 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 16:41:48.394157 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-6793d181-80fb-43d5-9d00-f21867d4bc27 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Calling method '>' {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:41:48.394803 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-6793d181-80fb-43d5-9d00-f21867d4bc27 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] [instance: bbc30718-1530-42df-bb08-c3418a02180f] Fetching instance by UUID {{(pid=102148) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:41:48.402020 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-6793d181-80fb-43d5-9d00-f21867d4bc27 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:41:48.402410 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-6793d181-80fb-43d5-9d00-f21867d4bc27 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:41:48.403414 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-6793d181-80fb-43d5-9d00-f21867d4bc27 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:41:48.403855 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-6793d181-80fb-43d5-9d00-f21867d4bc27 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:41:48.699483 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-6793d181-80fb-43d5-9d00-f21867d4bc27 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5ba17c9390249878062ee1b003e9d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b03d0f5f955c49f48e6f06aaa5aae5f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:41:48.709609 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-6793d181-80fb-43d5-9d00-f21867d4bc27 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] 10.222.0.18 "GET /compute/v2.1/servers/bbc30718-1530-42df-bb08-c3418a02180f" status: 200 len: 1699 microversion: 2.1 time: 0.319645 Jun 24 16:41:48.723820 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 447/883] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:41:48 2022] GET /compute/v2.1/servers/bbc30718-1530-42df-bb08-c3418a02180f => generated 1699 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 16:41:48.733976 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-94e08dca-08c0-4446-91aa-9bd709e37359 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 16:41:48.761498 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-94e08dca-08c0-4446-91aa-9bd709e37359 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:41:48.761498 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-94e08dca-08c0-4446-91aa-9bd709e37359 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:41:48.820704 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-94e08dca-08c0-4446-91aa-9bd709e37359 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] [instance: bbc30718-1530-42df-bb08-c3418a02180f] Going to try to start instance {{(pid=102149) start /opt/stack/nova/nova/compute/api.py:2625}} Jun 24 16:41:48.904944 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-94e08dca-08c0-4446-91aa-9bd709e37359 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] 10.222.0.18 "POST /compute/v2.1/servers/bbc30718-1530-42df-bb08-c3418a02180f/action" status: 202 len: 0 microversion: 2.1 time: 0.174581 Jun 24 16:41:48.905917 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 437/884] 10.222.0.18 () {60 vars in 1277 bytes} [Fri Jun 24 16:41:48 2022] POST /compute/v2.1/servers/bbc30718-1530-42df-bb08-c3418a02180f/action => generated 0 bytes in 177 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 24 16:41:48.914879 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-38688378-fd3b-4a91-8c41-96bafa9b63de tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Calling method '>' {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:41:48.915847 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-38688378-fd3b-4a91-8c41-96bafa9b63de tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] [instance: bbc30718-1530-42df-bb08-c3418a02180f] Fetching instance by UUID {{(pid=102148) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:41:48.925204 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-38688378-fd3b-4a91-8c41-96bafa9b63de tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:41:48.925806 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-38688378-fd3b-4a91-8c41-96bafa9b63de tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:41:48.926717 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-38688378-fd3b-4a91-8c41-96bafa9b63de tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:41:48.927278 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-38688378-fd3b-4a91-8c41-96bafa9b63de tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:41:49.724554 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-38688378-fd3b-4a91-8c41-96bafa9b63de tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5ba17c9390249878062ee1b003e9d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b03d0f5f955c49f48e6f06aaa5aae5f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:41:49.738771 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-38688378-fd3b-4a91-8c41-96bafa9b63de tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] 10.222.0.18 "GET /compute/v2.1/servers/bbc30718-1530-42df-bb08-c3418a02180f" status: 200 len: 1708 microversion: 2.1 time: 0.828308 Jun 24 16:41:49.741280 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 448/885] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:41:48 2022] GET /compute/v2.1/servers/bbc30718-1530-42df-bb08-c3418a02180f => generated 1708 bytes in 831 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 16:41:50.759232 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-2fb761f1-69fb-4783-b2dd-7b4d64fa92ea tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Calling method '>' {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:41:50.760753 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-2fb761f1-69fb-4783-b2dd-7b4d64fa92ea tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] [instance: bbc30718-1530-42df-bb08-c3418a02180f] Fetching instance by UUID {{(pid=102149) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:41:50.768678 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-2fb761f1-69fb-4783-b2dd-7b4d64fa92ea tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:41:50.769134 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-2fb761f1-69fb-4783-b2dd-7b4d64fa92ea tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:41:50.769955 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-2fb761f1-69fb-4783-b2dd-7b4d64fa92ea tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:41:50.770498 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-2fb761f1-69fb-4783-b2dd-7b4d64fa92ea tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:41:51.251648 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-2fb761f1-69fb-4783-b2dd-7b4d64fa92ea tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5ba17c9390249878062ee1b003e9d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b03d0f5f955c49f48e6f06aaa5aae5f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:41:51.260230 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-2fb761f1-69fb-4783-b2dd-7b4d64fa92ea tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] 10.222.0.18 "GET /compute/v2.1/servers/bbc30718-1530-42df-bb08-c3418a02180f" status: 200 len: 1712 microversion: 2.1 time: 0.506057 Jun 24 16:41:51.260793 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 438/886] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:41:50 2022] GET /compute/v2.1/servers/bbc30718-1530-42df-bb08-c3418a02180f => generated 1712 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 16:42:23.754859 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-413ac075-caec-4863-9ede-9cfeaf0f93c5 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Calling method '>' {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:42:23.755421 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-413ac075-caec-4863-9ede-9cfeaf0f93c5 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] [instance: bbc30718-1530-42df-bb08-c3418a02180f] Fetching instance by UUID {{(pid=102148) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:42:23.762483 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-413ac075-caec-4863-9ede-9cfeaf0f93c5 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:42:23.762961 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-413ac075-caec-4863-9ede-9cfeaf0f93c5 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:42:23.763719 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-413ac075-caec-4863-9ede-9cfeaf0f93c5 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:42:23.764148 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-413ac075-caec-4863-9ede-9cfeaf0f93c5 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:42:23.916327 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.objects.instance [None req-413ac075-caec-4863-9ede-9cfeaf0f93c5 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Lazy-loading 'services' on Instance uuid bbc30718-1530-42df-bb08-c3418a02180f {{(pid=102148) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Jun 24 16:42:24.055911 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-413ac075-caec-4863-9ede-9cfeaf0f93c5 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] 10.222.0.18 "DELETE /compute/v2.1/servers/bbc30718-1530-42df-bb08-c3418a02180f/os-volume_attachments/0133010f-62de-416f-bdaa-3172534bf07f" status: 202 len: 0 microversion: 2.1 time: 0.306419 Jun 24 16:42:24.056806 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 449/887] 10.222.0.18 () {58 vars in 1415 bytes} [Fri Jun 24 16:42:23 2022] DELETE /compute/v2.1/servers/bbc30718-1530-42df-bb08-c3418a02180f/os-volume_attachments/0133010f-62de-416f-bdaa-3172534bf07f => generated 0 bytes in 308 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 24 16:42:25.227697 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-6b533bd7-2426-4d52-8c1b-65684e5edfd1 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 16:42:25.236318 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-6b533bd7-2426-4d52-8c1b-65684e5edfd1 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:42:25.236777 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-6b533bd7-2426-4d52-8c1b-65684e5edfd1 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:42:25.291722 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-6b533bd7-2426-4d52-8c1b-65684e5edfd1 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] [instance: bbc30718-1530-42df-bb08-c3418a02180f] Going to try to stop instance {{(pid=102149) force_stop /opt/stack/nova/nova/compute/api.py:2602}} Jun 24 16:42:25.373187 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-6b533bd7-2426-4d52-8c1b-65684e5edfd1 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] 10.222.0.18 "POST /compute/v2.1/servers/bbc30718-1530-42df-bb08-c3418a02180f/action" status: 202 len: 0 microversion: 2.1 time: 0.148401 Jun 24 16:42:25.373795 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 439/888] 10.222.0.18 () {60 vars in 1277 bytes} [Fri Jun 24 16:42:25 2022] POST /compute/v2.1/servers/bbc30718-1530-42df-bb08-c3418a02180f/action => generated 0 bytes in 150 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 24 16:42:25.382672 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-43ecc6c8-ca6e-48bf-8d72-f9e0c6edbdbe tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Calling method '>' {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:42:25.383109 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-43ecc6c8-ca6e-48bf-8d72-f9e0c6edbdbe tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] [instance: bbc30718-1530-42df-bb08-c3418a02180f] Fetching instance by UUID {{(pid=102148) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:42:25.391271 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-43ecc6c8-ca6e-48bf-8d72-f9e0c6edbdbe tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:42:25.391716 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-43ecc6c8-ca6e-48bf-8d72-f9e0c6edbdbe tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:42:25.392489 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-43ecc6c8-ca6e-48bf-8d72-f9e0c6edbdbe tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:42:25.392920 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-43ecc6c8-ca6e-48bf-8d72-f9e0c6edbdbe tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:42:25.597843 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-43ecc6c8-ca6e-48bf-8d72-f9e0c6edbdbe tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5ba17c9390249878062ee1b003e9d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b03d0f5f955c49f48e6f06aaa5aae5f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:42:25.605978 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-43ecc6c8-ca6e-48bf-8d72-f9e0c6edbdbe tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] 10.222.0.18 "GET /compute/v2.1/servers/bbc30718-1530-42df-bb08-c3418a02180f" status: 200 len: 1676 microversion: 2.1 time: 0.227752 Jun 24 16:42:25.606519 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 450/889] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:42:25 2022] GET /compute/v2.1/servers/bbc30718-1530-42df-bb08-c3418a02180f => generated 1676 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 16:42:26.625921 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-c531a4e9-d6ed-44dd-ab58-40acda7e3c55 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Calling method '>' {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:42:26.626622 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-c531a4e9-d6ed-44dd-ab58-40acda7e3c55 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] [instance: bbc30718-1530-42df-bb08-c3418a02180f] Fetching instance by UUID {{(pid=102149) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:42:26.634187 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-c531a4e9-d6ed-44dd-ab58-40acda7e3c55 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:42:26.634580 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-c531a4e9-d6ed-44dd-ab58-40acda7e3c55 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:42:26.635384 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-c531a4e9-d6ed-44dd-ab58-40acda7e3c55 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:42:26.635818 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-c531a4e9-d6ed-44dd-ab58-40acda7e3c55 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:42:26.834257 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-c531a4e9-d6ed-44dd-ab58-40acda7e3c55 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5ba17c9390249878062ee1b003e9d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b03d0f5f955c49f48e6f06aaa5aae5f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:42:26.842302 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-c531a4e9-d6ed-44dd-ab58-40acda7e3c55 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] 10.222.0.18 "GET /compute/v2.1/servers/bbc30718-1530-42df-bb08-c3418a02180f" status: 200 len: 1676 microversion: 2.1 time: 0.220558 Jun 24 16:42:26.842881 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 440/890] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:42:26 2022] GET /compute/v2.1/servers/bbc30718-1530-42df-bb08-c3418a02180f => generated 1676 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 16:42:27.860339 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-76095112-d97d-4206-aec3-bc4a19702632 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Calling method '>' {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:42:27.860968 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-76095112-d97d-4206-aec3-bc4a19702632 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] [instance: bbc30718-1530-42df-bb08-c3418a02180f] Fetching instance by UUID {{(pid=102148) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:42:27.868342 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-76095112-d97d-4206-aec3-bc4a19702632 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:42:27.868782 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-76095112-d97d-4206-aec3-bc4a19702632 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:42:27.869532 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-76095112-d97d-4206-aec3-bc4a19702632 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:42:27.869959 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-76095112-d97d-4206-aec3-bc4a19702632 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:42:28.073998 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-76095112-d97d-4206-aec3-bc4a19702632 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5ba17c9390249878062ee1b003e9d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b03d0f5f955c49f48e6f06aaa5aae5f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:42:28.082450 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-76095112-d97d-4206-aec3-bc4a19702632 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] 10.222.0.18 "GET /compute/v2.1/servers/bbc30718-1530-42df-bb08-c3418a02180f" status: 200 len: 1676 microversion: 2.1 time: 0.226346 Jun 24 16:42:28.083041 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 451/891] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:42:27 2022] GET /compute/v2.1/servers/bbc30718-1530-42df-bb08-c3418a02180f => generated 1676 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 16:42:29.099729 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-787a13fa-615b-428d-b04f-802984bb0edb tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Calling method '>' {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:42:29.100354 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-787a13fa-615b-428d-b04f-802984bb0edb tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] [instance: bbc30718-1530-42df-bb08-c3418a02180f] Fetching instance by UUID {{(pid=102149) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:42:29.107580 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-787a13fa-615b-428d-b04f-802984bb0edb tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:42:29.108015 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-787a13fa-615b-428d-b04f-802984bb0edb tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:42:29.109432 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-787a13fa-615b-428d-b04f-802984bb0edb tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:42:29.109860 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-787a13fa-615b-428d-b04f-802984bb0edb tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:42:29.310668 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-787a13fa-615b-428d-b04f-802984bb0edb tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5ba17c9390249878062ee1b003e9d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b03d0f5f955c49f48e6f06aaa5aae5f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:42:29.319792 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-787a13fa-615b-428d-b04f-802984bb0edb tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] 10.222.0.18 "GET /compute/v2.1/servers/bbc30718-1530-42df-bb08-c3418a02180f" status: 200 len: 1676 microversion: 2.1 time: 0.223763 Jun 24 16:42:29.320352 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 441/892] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:42:29 2022] GET /compute/v2.1/servers/bbc30718-1530-42df-bb08-c3418a02180f => generated 1676 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 16:42:30.337092 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-2a59dfed-c2e9-4948-b514-98289464b7e0 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Calling method '>' {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:42:30.337820 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-2a59dfed-c2e9-4948-b514-98289464b7e0 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] [instance: bbc30718-1530-42df-bb08-c3418a02180f] Fetching instance by UUID {{(pid=102148) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:42:30.345749 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-2a59dfed-c2e9-4948-b514-98289464b7e0 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:42:30.346201 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-2a59dfed-c2e9-4948-b514-98289464b7e0 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:42:30.346996 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-2a59dfed-c2e9-4948-b514-98289464b7e0 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:42:30.347441 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-2a59dfed-c2e9-4948-b514-98289464b7e0 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:42:30.549091 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-2a59dfed-c2e9-4948-b514-98289464b7e0 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5ba17c9390249878062ee1b003e9d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b03d0f5f955c49f48e6f06aaa5aae5f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:42:30.557570 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-2a59dfed-c2e9-4948-b514-98289464b7e0 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] 10.222.0.18 "GET /compute/v2.1/servers/bbc30718-1530-42df-bb08-c3418a02180f" status: 200 len: 1676 microversion: 2.1 time: 0.224133 Jun 24 16:42:30.558134 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 452/893] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:42:30 2022] GET /compute/v2.1/servers/bbc30718-1530-42df-bb08-c3418a02180f => generated 1676 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 16:42:31.575634 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-46b3df1d-98b6-4b53-b9bf-8e60667619df tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Calling method '>' {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:42:31.576954 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-46b3df1d-98b6-4b53-b9bf-8e60667619df tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] [instance: bbc30718-1530-42df-bb08-c3418a02180f] Fetching instance by UUID {{(pid=102149) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:42:31.585234 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-46b3df1d-98b6-4b53-b9bf-8e60667619df tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:42:31.585684 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-46b3df1d-98b6-4b53-b9bf-8e60667619df tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:42:31.586535 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-46b3df1d-98b6-4b53-b9bf-8e60667619df tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:42:31.587003 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-46b3df1d-98b6-4b53-b9bf-8e60667619df tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:42:31.806501 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-46b3df1d-98b6-4b53-b9bf-8e60667619df tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5ba17c9390249878062ee1b003e9d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b03d0f5f955c49f48e6f06aaa5aae5f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:42:31.814918 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-46b3df1d-98b6-4b53-b9bf-8e60667619df tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] 10.222.0.18 "GET /compute/v2.1/servers/bbc30718-1530-42df-bb08-c3418a02180f" status: 200 len: 1676 microversion: 2.1 time: 0.243678 Jun 24 16:42:31.815483 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 442/894] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:42:31 2022] GET /compute/v2.1/servers/bbc30718-1530-42df-bb08-c3418a02180f => generated 1676 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 16:42:32.041259 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-ab7bc6ba-a85b-4752-a28a-15a7e889a7e5 tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Calling method '>' {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:42:32.041797 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-ab7bc6ba-a85b-4752-a28a-15a7e889a7e5 tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] [instance: 45111d6d-035d-465f-8cd8-aaebebeca3e7] Fetching instance by UUID {{(pid=102148) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:42:32.050664 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-ab7bc6ba-a85b-4752-a28a-15a7e889a7e5 tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:42:32.051386 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-ab7bc6ba-a85b-4752-a28a-15a7e889a7e5 tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:42:32.052164 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-ab7bc6ba-a85b-4752-a28a-15a7e889a7e5 tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:42:32.052768 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-ab7bc6ba-a85b-4752-a28a-15a7e889a7e5 tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:42:32.114811 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-ab7bc6ba-a85b-4752-a28a-15a7e889a7e5 tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] [instance: 45111d6d-035d-465f-8cd8-aaebebeca3e7] Going to try to terminate instance {{(pid=102148) delete /opt/stack/nova/nova/compute/api.py:2562}} Jun 24 16:42:32.236855 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-ab7bc6ba-a85b-4752-a28a-15a7e889a7e5 tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] 10.222.0.18 "DELETE /compute/v2.1/servers/45111d6d-035d-465f-8cd8-aaebebeca3e7" status: 204 len: 0 microversion: 2.1 time: 0.199020 Jun 24 16:42:32.237719 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 453/895] 10.222.0.18 () {58 vars in 1238 bytes} [Fri Jun 24 16:42:32 2022] DELETE /compute/v2.1/servers/45111d6d-035d-465f-8cd8-aaebebeca3e7 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 24 16:42:32.243730 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [req-8ba5f699-a263-44dc-864a-3019c7dc2497 req-ec316e82-fddf-46ba-ac1e-b676afc62336 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "45111d6d-035d-465f-8cd8-aaebebeca3e7", "tag": "5ca97655-924b-4e05-814b-f5434e316687"}]} {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 16:42:32.245382 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 24 16:42:32.245382 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: warnings.warn(msg) Jun 24 16:42:32.246493 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-53f959a2-f717-4d33-9d7f-07991c6d007e tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Calling method '>' {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:42:32.247237 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-53f959a2-f717-4d33-9d7f-07991c6d007e tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] [instance: 45111d6d-035d-465f-8cd8-aaebebeca3e7] Fetching instance by UUID {{(pid=102148) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:42:32.255475 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-53f959a2-f717-4d33-9d7f-07991c6d007e tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:42:32.255925 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-53f959a2-f717-4d33-9d7f-07991c6d007e tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:42:32.256075 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [req-8ba5f699-a263-44dc-864a-3019c7dc2497 req-ec316e82-fddf-46ba-ac1e-b676afc62336 service nova] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:42:32.256421 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [req-8ba5f699-a263-44dc-864a-3019c7dc2497 req-ec316e82-fddf-46ba-ac1e-b676afc62336 service nova] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:42:32.256701 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-53f959a2-f717-4d33-9d7f-07991c6d007e tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:42:32.257182 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-53f959a2-f717-4d33-9d7f-07991c6d007e tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:42:32.272972 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.compute.server_external_events [req-8ba5f699-a263-44dc-864a-3019c7dc2497 req-ec316e82-fddf-46ba-ac1e-b676afc62336 service nova] Creating event network-changed:5ca97655-924b-4e05-814b-f5434e316687 for instance 45111d6d-035d-465f-8cd8-aaebebeca3e7 on hv-cinder-84718 Jun 24 16:42:32.277836 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [req-8ba5f699-a263-44dc-864a-3019c7dc2497 req-ec316e82-fddf-46ba-ac1e-b676afc62336 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.239688 Jun 24 16:42:32.278707 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 443/896] 10.222.0.18 () {64 vars in 1317 bytes} [Fri Jun 24 16:42:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 16:42:32.478377 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-53f959a2-f717-4d33-9d7f-07991c6d007e tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65d11cab328748d5a8f5e55eb439e334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901fbc33d59d49f8afa7f06d62e19e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:42:32.487872 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-53f959a2-f717-4d33-9d7f-07991c6d007e tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] 10.222.0.18 "GET /compute/v2.1/servers/45111d6d-035d-465f-8cd8-aaebebeca3e7" status: 200 len: 1577 microversion: 2.1 time: 0.245573 Jun 24 16:42:32.488646 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 454/897] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:42:32 2022] GET /compute/v2.1/servers/45111d6d-035d-465f-8cd8-aaebebeca3e7 => generated 1577 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 16:42:32.832779 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-9f42881b-0273-4bf1-be71-42001b6cc618 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Calling method '>' {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:42:32.834323 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-9f42881b-0273-4bf1-be71-42001b6cc618 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] [instance: bbc30718-1530-42df-bb08-c3418a02180f] Fetching instance by UUID {{(pid=102149) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:42:32.841918 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-9f42881b-0273-4bf1-be71-42001b6cc618 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:42:32.842379 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-9f42881b-0273-4bf1-be71-42001b6cc618 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:42:32.843182 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-9f42881b-0273-4bf1-be71-42001b6cc618 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:42:32.843620 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-9f42881b-0273-4bf1-be71-42001b6cc618 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:42:33.058854 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-9f42881b-0273-4bf1-be71-42001b6cc618 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5ba17c9390249878062ee1b003e9d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b03d0f5f955c49f48e6f06aaa5aae5f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:42:33.068632 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-9f42881b-0273-4bf1-be71-42001b6cc618 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] 10.222.0.18 "GET /compute/v2.1/servers/bbc30718-1530-42df-bb08-c3418a02180f" status: 200 len: 1676 microversion: 2.1 time: 0.239890 Jun 24 16:42:33.069528 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 444/898] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:42:32 2022] GET /compute/v2.1/servers/bbc30718-1530-42df-bb08-c3418a02180f => generated 1676 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 16:42:33.507267 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-237b7cbf-38ab-42e1-9efd-ceb18ebe2e56 tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Calling method '>' {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:42:33.507916 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-237b7cbf-38ab-42e1-9efd-ceb18ebe2e56 tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] [instance: 45111d6d-035d-465f-8cd8-aaebebeca3e7] Fetching instance by UUID {{(pid=102148) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:42:33.516009 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-237b7cbf-38ab-42e1-9efd-ceb18ebe2e56 tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:42:33.516450 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-237b7cbf-38ab-42e1-9efd-ceb18ebe2e56 tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:42:33.517212 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-237b7cbf-38ab-42e1-9efd-ceb18ebe2e56 tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:42:33.517636 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-237b7cbf-38ab-42e1-9efd-ceb18ebe2e56 tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:42:33.722177 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-237b7cbf-38ab-42e1-9efd-ceb18ebe2e56 tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65d11cab328748d5a8f5e55eb439e334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901fbc33d59d49f8afa7f06d62e19e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:42:33.730331 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-237b7cbf-38ab-42e1-9efd-ceb18ebe2e56 tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] 10.222.0.18 "GET /compute/v2.1/servers/45111d6d-035d-465f-8cd8-aaebebeca3e7" status: 200 len: 1458 microversion: 2.1 time: 0.226707 Jun 24 16:42:33.731049 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 455/899] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:42:33 2022] GET /compute/v2.1/servers/45111d6d-035d-465f-8cd8-aaebebeca3e7 => generated 1458 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 16:42:34.086374 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-6537d2c1-e48e-42f5-a58b-0b9a1c4cc799 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Calling method '>' {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:42:34.087079 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-6537d2c1-e48e-42f5-a58b-0b9a1c4cc799 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] [instance: bbc30718-1530-42df-bb08-c3418a02180f] Fetching instance by UUID {{(pid=102149) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:42:34.094855 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-6537d2c1-e48e-42f5-a58b-0b9a1c4cc799 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:42:34.095304 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-6537d2c1-e48e-42f5-a58b-0b9a1c4cc799 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:42:34.096084 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-6537d2c1-e48e-42f5-a58b-0b9a1c4cc799 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:42:34.096514 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-6537d2c1-e48e-42f5-a58b-0b9a1c4cc799 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:42:34.299283 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-6537d2c1-e48e-42f5-a58b-0b9a1c4cc799 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5ba17c9390249878062ee1b003e9d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b03d0f5f955c49f48e6f06aaa5aae5f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:42:34.308218 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-6537d2c1-e48e-42f5-a58b-0b9a1c4cc799 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] 10.222.0.18 "GET /compute/v2.1/servers/bbc30718-1530-42df-bb08-c3418a02180f" status: 200 len: 1676 microversion: 2.1 time: 0.225417 Jun 24 16:42:34.308811 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 445/900] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:42:34 2022] GET /compute/v2.1/servers/bbc30718-1530-42df-bb08-c3418a02180f => generated 1676 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 16:42:34.747636 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-78375f3c-98ff-4063-aecb-1d728251f0e6 tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Calling method '>' {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:42:34.748415 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-78375f3c-98ff-4063-aecb-1d728251f0e6 tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] [instance: 45111d6d-035d-465f-8cd8-aaebebeca3e7] Fetching instance by UUID {{(pid=102148) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:42:34.756545 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-78375f3c-98ff-4063-aecb-1d728251f0e6 tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:42:34.756998 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-78375f3c-98ff-4063-aecb-1d728251f0e6 tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:42:34.757818 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-78375f3c-98ff-4063-aecb-1d728251f0e6 tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:42:34.758218 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-78375f3c-98ff-4063-aecb-1d728251f0e6 tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:42:34.856017 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [req-50dc04a1-949b-4039-84f1-646f172b9879 req-f85b0b75-f5f2-4772-b830-838e9377b39d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "45111d6d-035d-465f-8cd8-aaebebeca3e7", "name": "network-vif-deleted", "tag": "5ca97655-924b-4e05-814b-f5434e316687"}]} {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 16:42:34.857591 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 24 16:42:34.857591 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: warnings.warn(msg) Jun 24 16:42:34.867161 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [req-50dc04a1-949b-4039-84f1-646f172b9879 req-f85b0b75-f5f2-4772-b830-838e9377b39d service nova] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:42:34.867890 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [req-50dc04a1-949b-4039-84f1-646f172b9879 req-f85b0b75-f5f2-4772-b830-838e9377b39d service nova] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:42:34.891332 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.compute.server_external_events [req-50dc04a1-949b-4039-84f1-646f172b9879 req-f85b0b75-f5f2-4772-b830-838e9377b39d service nova] Creating event network-vif-deleted:5ca97655-924b-4e05-814b-f5434e316687 for instance 45111d6d-035d-465f-8cd8-aaebebeca3e7 on hv-cinder-84718 Jun 24 16:42:34.896374 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [req-50dc04a1-949b-4039-84f1-646f172b9879 req-f85b0b75-f5f2-4772-b830-838e9377b39d service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043746 Jun 24 16:42:34.897047 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 446/901] 10.222.0.18 () {64 vars in 1317 bytes} [Fri Jun 24 16:42:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 16:42:34.987059 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-78375f3c-98ff-4063-aecb-1d728251f0e6 tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65d11cab328748d5a8f5e55eb439e334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901fbc33d59d49f8afa7f06d62e19e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:42:34.995438 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-78375f3c-98ff-4063-aecb-1d728251f0e6 tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] 10.222.0.18 "GET /compute/v2.1/servers/45111d6d-035d-465f-8cd8-aaebebeca3e7" status: 200 len: 1390 microversion: 2.1 time: 0.251486 Jun 24 16:42:34.995988 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 456/902] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:42:34 2022] GET /compute/v2.1/servers/45111d6d-035d-465f-8cd8-aaebebeca3e7 => generated 1390 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 16:42:35.326288 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-26625e24-b3e2-48ce-9723-9bc5fbac4614 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Calling method '>' {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:42:35.327369 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-26625e24-b3e2-48ce-9723-9bc5fbac4614 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] [instance: bbc30718-1530-42df-bb08-c3418a02180f] Fetching instance by UUID {{(pid=102149) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:42:35.335306 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-26625e24-b3e2-48ce-9723-9bc5fbac4614 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:42:35.335694 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-26625e24-b3e2-48ce-9723-9bc5fbac4614 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:42:35.336492 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-26625e24-b3e2-48ce-9723-9bc5fbac4614 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:42:35.336917 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-26625e24-b3e2-48ce-9723-9bc5fbac4614 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:42:35.552096 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-26625e24-b3e2-48ce-9723-9bc5fbac4614 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5ba17c9390249878062ee1b003e9d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b03d0f5f955c49f48e6f06aaa5aae5f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:42:35.560205 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-26625e24-b3e2-48ce-9723-9bc5fbac4614 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] 10.222.0.18 "GET /compute/v2.1/servers/bbc30718-1530-42df-bb08-c3418a02180f" status: 200 len: 1676 microversion: 2.1 time: 0.238328 Jun 24 16:42:35.560767 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 447/903] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:42:35 2022] GET /compute/v2.1/servers/bbc30718-1530-42df-bb08-c3418a02180f => generated 1676 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 16:42:36.013184 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-b89d76ee-d0c1-4b4a-b195-ac8aef6e7835 tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Calling method '>' {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:42:36.013808 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-b89d76ee-d0c1-4b4a-b195-ac8aef6e7835 tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] [instance: 45111d6d-035d-465f-8cd8-aaebebeca3e7] Fetching instance by UUID {{(pid=102148) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:42:36.021535 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-b89d76ee-d0c1-4b4a-b195-ac8aef6e7835 tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:42:36.021976 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-b89d76ee-d0c1-4b4a-b195-ac8aef6e7835 tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:42:36.022749 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-b89d76ee-d0c1-4b4a-b195-ac8aef6e7835 tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:42:36.023179 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-b89d76ee-d0c1-4b4a-b195-ac8aef6e7835 tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:42:36.074463 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.wsgi [None req-b89d76ee-d0c1-4b4a-b195-ac8aef6e7835 tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] HTTP exception thrown: Instance 45111d6d-035d-465f-8cd8-aaebebeca3e7 could not be found. Jun 24 16:42:36.075227 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-b89d76ee-d0c1-4b4a-b195-ac8aef6e7835 tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Returning 404 to user: Instance 45111d6d-035d-465f-8cd8-aaebebeca3e7 could not be found. {{(pid=102148) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jun 24 16:42:36.076047 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-b89d76ee-d0c1-4b4a-b195-ac8aef6e7835 tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] 10.222.0.18 "GET /compute/v2.1/servers/45111d6d-035d-465f-8cd8-aaebebeca3e7" status: 404 len: 111 microversion: 2.1 time: 0.066687 Jun 24 16:42:36.076599 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 457/904] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:42:36 2022] GET /compute/v2.1/servers/45111d6d-035d-465f-8cd8-aaebebeca3e7 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 16:42:36.576713 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-9a41846d-cf55-4615-a188-2feb1620daa0 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Calling method '>' {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:42:36.578135 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-9a41846d-cf55-4615-a188-2feb1620daa0 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] [instance: bbc30718-1530-42df-bb08-c3418a02180f] Fetching instance by UUID {{(pid=102149) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:42:36.585604 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-9a41846d-cf55-4615-a188-2feb1620daa0 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:42:36.586054 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-9a41846d-cf55-4615-a188-2feb1620daa0 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:42:36.586857 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-9a41846d-cf55-4615-a188-2feb1620daa0 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:42:36.587289 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-9a41846d-cf55-4615-a188-2feb1620daa0 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:42:36.786158 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-9a41846d-cf55-4615-a188-2feb1620daa0 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5ba17c9390249878062ee1b003e9d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b03d0f5f955c49f48e6f06aaa5aae5f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:42:36.794289 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-9a41846d-cf55-4615-a188-2feb1620daa0 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] 10.222.0.18 "GET /compute/v2.1/servers/bbc30718-1530-42df-bb08-c3418a02180f" status: 200 len: 1653 microversion: 2.1 time: 0.221317 Jun 24 16:42:36.794876 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 448/905] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:42:36 2022] GET /compute/v2.1/servers/bbc30718-1530-42df-bb08-c3418a02180f => generated 1653 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 16:42:36.810563 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-31f66234-6e00-48b1-aba5-19b1396a69be tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 16:42:36.818440 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-31f66234-6e00-48b1-aba5-19b1396a69be tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:42:36.818915 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-31f66234-6e00-48b1-aba5-19b1396a69be tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:42:36.877616 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-31f66234-6e00-48b1-aba5-19b1396a69be tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] [instance: bbc30718-1530-42df-bb08-c3418a02180f] Going to try to start instance {{(pid=102148) start /opt/stack/nova/nova/compute/api.py:2625}} Jun 24 16:42:36.952929 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-31f66234-6e00-48b1-aba5-19b1396a69be tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] 10.222.0.18 "POST /compute/v2.1/servers/bbc30718-1530-42df-bb08-c3418a02180f/action" status: 202 len: 0 microversion: 2.1 time: 0.145499 Jun 24 16:42:36.953556 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 458/906] 10.222.0.18 () {60 vars in 1277 bytes} [Fri Jun 24 16:42:36 2022] POST /compute/v2.1/servers/bbc30718-1530-42df-bb08-c3418a02180f/action => generated 0 bytes in 147 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 24 16:42:36.961588 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-9d837c10-b99d-49a9-94c3-489e0bc3d091 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Calling method '>' {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:42:36.962333 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-9d837c10-b99d-49a9-94c3-489e0bc3d091 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] [instance: bbc30718-1530-42df-bb08-c3418a02180f] Fetching instance by UUID {{(pid=102149) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:42:36.970115 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-9d837c10-b99d-49a9-94c3-489e0bc3d091 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:42:36.970565 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-9d837c10-b99d-49a9-94c3-489e0bc3d091 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:42:36.971438 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-9d837c10-b99d-49a9-94c3-489e0bc3d091 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:42:36.971889 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-9d837c10-b99d-49a9-94c3-489e0bc3d091 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:42:37.177244 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-9d837c10-b99d-49a9-94c3-489e0bc3d091 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5ba17c9390249878062ee1b003e9d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b03d0f5f955c49f48e6f06aaa5aae5f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:42:37.185327 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-9d837c10-b99d-49a9-94c3-489e0bc3d091 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] 10.222.0.18 "GET /compute/v2.1/servers/bbc30718-1530-42df-bb08-c3418a02180f" status: 200 len: 1662 microversion: 2.1 time: 0.227369 Jun 24 16:42:37.185890 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 449/907] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:42:36 2022] GET /compute/v2.1/servers/bbc30718-1530-42df-bb08-c3418a02180f => generated 1662 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 16:42:38.203717 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-fa47ba75-3e99-4e7d-b628-3ecfc8308537 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Calling method '>' {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:42:38.204456 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-fa47ba75-3e99-4e7d-b628-3ecfc8308537 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] [instance: bbc30718-1530-42df-bb08-c3418a02180f] Fetching instance by UUID {{(pid=102148) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:42:38.212884 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-fa47ba75-3e99-4e7d-b628-3ecfc8308537 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:42:38.213342 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-fa47ba75-3e99-4e7d-b628-3ecfc8308537 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:42:38.214124 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-fa47ba75-3e99-4e7d-b628-3ecfc8308537 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:42:38.214563 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-fa47ba75-3e99-4e7d-b628-3ecfc8308537 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:42:38.428101 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-fa47ba75-3e99-4e7d-b628-3ecfc8308537 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5ba17c9390249878062ee1b003e9d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b03d0f5f955c49f48e6f06aaa5aae5f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:42:38.436638 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-fa47ba75-3e99-4e7d-b628-3ecfc8308537 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] 10.222.0.18 "GET /compute/v2.1/servers/bbc30718-1530-42df-bb08-c3418a02180f" status: 200 len: 1662 microversion: 2.1 time: 0.237613 Jun 24 16:42:38.437199 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 459/908] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:42:38 2022] GET /compute/v2.1/servers/bbc30718-1530-42df-bb08-c3418a02180f => generated 1662 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 16:42:39.454476 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-3b153969-bd66-4553-8f19-acd543691dab tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Calling method '>' {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:42:39.455107 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-3b153969-bd66-4553-8f19-acd543691dab tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] [instance: bbc30718-1530-42df-bb08-c3418a02180f] Fetching instance by UUID {{(pid=102149) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:42:39.463092 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-3b153969-bd66-4553-8f19-acd543691dab tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:42:39.463535 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-3b153969-bd66-4553-8f19-acd543691dab tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:42:39.464309 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-3b153969-bd66-4553-8f19-acd543691dab tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:42:39.464735 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-3b153969-bd66-4553-8f19-acd543691dab tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:42:39.965859 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-3b153969-bd66-4553-8f19-acd543691dab tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5ba17c9390249878062ee1b003e9d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b03d0f5f955c49f48e6f06aaa5aae5f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:42:39.974796 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-3b153969-bd66-4553-8f19-acd543691dab tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] 10.222.0.18 "GET /compute/v2.1/servers/bbc30718-1530-42df-bb08-c3418a02180f" status: 200 len: 1666 microversion: 2.1 time: 0.525244 Jun 24 16:42:39.975356 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 450/909] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:42:39 2022] GET /compute/v2.1/servers/bbc30718-1530-42df-bb08-c3418a02180f => generated 1666 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 16:42:40.091228 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-19f3e57f-5441-45b0-bcdf-e66f2ad5bd99 tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Calling method '>' {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:42:40.091994 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-19f3e57f-5441-45b0-bcdf-e66f2ad5bd99 tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] [instance: acca3424-5f32-44c3-8c4c-fae78593ac50] Fetching instance by UUID {{(pid=102148) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:42:40.100363 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-19f3e57f-5441-45b0-bcdf-e66f2ad5bd99 tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:42:40.100824 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-19f3e57f-5441-45b0-bcdf-e66f2ad5bd99 tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:42:40.101604 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-19f3e57f-5441-45b0-bcdf-e66f2ad5bd99 tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:42:40.102204 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-19f3e57f-5441-45b0-bcdf-e66f2ad5bd99 tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:42:40.153313 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [req-db4e7392-e135-430b-8017-25274b98f120 req-56c54eb8-6a5d-4ebb-8532-aa836ad189be service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "acca3424-5f32-44c3-8c4c-fae78593ac50", "tag": "50d5fc77-615e-4930-a0d1-7ba5a8aede09"}]} {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 16:42:40.154938 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 24 16:42:40.154938 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: warnings.warn(msg) Jun 24 16:42:40.163618 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [req-db4e7392-e135-430b-8017-25274b98f120 req-56c54eb8-6a5d-4ebb-8532-aa836ad189be service nova] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:42:40.164066 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [req-db4e7392-e135-430b-8017-25274b98f120 req-56c54eb8-6a5d-4ebb-8532-aa836ad189be service nova] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:42:40.165166 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-19f3e57f-5441-45b0-bcdf-e66f2ad5bd99 tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] [instance: acca3424-5f32-44c3-8c4c-fae78593ac50] Going to try to terminate instance {{(pid=102148) delete /opt/stack/nova/nova/compute/api.py:2562}} Jun 24 16:42:40.181678 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.compute.server_external_events [req-db4e7392-e135-430b-8017-25274b98f120 req-56c54eb8-6a5d-4ebb-8532-aa836ad189be service nova] Creating event network-changed:50d5fc77-615e-4930-a0d1-7ba5a8aede09 for instance acca3424-5f32-44c3-8c4c-fae78593ac50 on hv-cinder-84718 Jun 24 16:42:40.186460 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [req-db4e7392-e135-430b-8017-25274b98f120 req-56c54eb8-6a5d-4ebb-8532-aa836ad189be service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096474 Jun 24 16:42:40.187229 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 451/910] 10.222.0.18 () {64 vars in 1317 bytes} [Fri Jun 24 16:42:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 16:42:40.297899 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-19f3e57f-5441-45b0-bcdf-e66f2ad5bd99 tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] 10.222.0.18 "DELETE /compute/v2.1/servers/acca3424-5f32-44c3-8c4c-fae78593ac50" status: 204 len: 0 microversion: 2.1 time: 0.208825 Jun 24 16:42:40.298578 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 460/911] 10.222.0.18 () {58 vars in 1238 bytes} [Fri Jun 24 16:42:40 2022] DELETE /compute/v2.1/servers/acca3424-5f32-44c3-8c4c-fae78593ac50 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 24 16:42:40.307724 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-71c969b1-c83b-44e9-9be1-33f3133fe557 tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Calling method '>' {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:42:40.308399 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-71c969b1-c83b-44e9-9be1-33f3133fe557 tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] [instance: acca3424-5f32-44c3-8c4c-fae78593ac50] Fetching instance by UUID {{(pid=102149) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:42:40.316112 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-71c969b1-c83b-44e9-9be1-33f3133fe557 tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:42:40.316562 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-71c969b1-c83b-44e9-9be1-33f3133fe557 tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:42:40.317333 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-71c969b1-c83b-44e9-9be1-33f3133fe557 tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:42:40.317956 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-71c969b1-c83b-44e9-9be1-33f3133fe557 tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:42:40.559428 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-71c969b1-c83b-44e9-9be1-33f3133fe557 tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65d11cab328748d5a8f5e55eb439e334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901fbc33d59d49f8afa7f06d62e19e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:42:40.573224 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-71c969b1-c83b-44e9-9be1-33f3133fe557 tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] 10.222.0.18 "GET /compute/v2.1/servers/acca3424-5f32-44c3-8c4c-fae78593ac50" status: 200 len: 1577 microversion: 2.1 time: 0.269746 Jun 24 16:42:40.574244 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 452/912] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:42:40 2022] GET /compute/v2.1/servers/acca3424-5f32-44c3-8c4c-fae78593ac50 => generated 1577 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 16:42:41.593106 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-17b6b04a-8dae-4196-8868-18d0712b1db7 tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Calling method '>' {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:42:41.593975 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-17b6b04a-8dae-4196-8868-18d0712b1db7 tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] [instance: acca3424-5f32-44c3-8c4c-fae78593ac50] Fetching instance by UUID {{(pid=102148) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:42:41.601233 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-17b6b04a-8dae-4196-8868-18d0712b1db7 tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:42:41.601677 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-17b6b04a-8dae-4196-8868-18d0712b1db7 tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:42:41.602439 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-17b6b04a-8dae-4196-8868-18d0712b1db7 tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:42:41.602891 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-17b6b04a-8dae-4196-8868-18d0712b1db7 tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:42:41.812444 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-17b6b04a-8dae-4196-8868-18d0712b1db7 tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65d11cab328748d5a8f5e55eb439e334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901fbc33d59d49f8afa7f06d62e19e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:42:41.820504 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-17b6b04a-8dae-4196-8868-18d0712b1db7 tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] 10.222.0.18 "GET /compute/v2.1/servers/acca3424-5f32-44c3-8c4c-fae78593ac50" status: 200 len: 1458 microversion: 2.1 time: 0.232215 Jun 24 16:42:41.821057 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 461/913] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:42:41 2022] GET /compute/v2.1/servers/acca3424-5f32-44c3-8c4c-fae78593ac50 => generated 1458 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 16:42:42.837497 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-0e849ed2-2111-48d5-901d-80d658bee080 tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Calling method '>' {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:42:42.838147 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-0e849ed2-2111-48d5-901d-80d658bee080 tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] [instance: acca3424-5f32-44c3-8c4c-fae78593ac50] Fetching instance by UUID {{(pid=102149) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:42:42.846368 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-0e849ed2-2111-48d5-901d-80d658bee080 tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:42:42.846864 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-0e849ed2-2111-48d5-901d-80d658bee080 tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:42:42.847648 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-0e849ed2-2111-48d5-901d-80d658bee080 tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:42:42.848087 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-0e849ed2-2111-48d5-901d-80d658bee080 tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:42:42.896855 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [req-369b3935-998d-430a-ba39-7d18f214096f req-8b42def7-9283-4eb4-8732-5bb7259fd0a6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "acca3424-5f32-44c3-8c4c-fae78593ac50", "name": "network-vif-deleted", "tag": "50d5fc77-615e-4930-a0d1-7ba5a8aede09"}]} {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 16:42:42.898442 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 24 16:42:42.898442 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: warnings.warn(msg) Jun 24 16:42:42.906788 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [req-369b3935-998d-430a-ba39-7d18f214096f req-8b42def7-9283-4eb4-8732-5bb7259fd0a6 service nova] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:42:42.907230 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [req-369b3935-998d-430a-ba39-7d18f214096f req-8b42def7-9283-4eb4-8732-5bb7259fd0a6 service nova] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:42:42.934043 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.compute.server_external_events [req-369b3935-998d-430a-ba39-7d18f214096f req-8b42def7-9283-4eb4-8732-5bb7259fd0a6 service nova] Creating event network-vif-deleted:50d5fc77-615e-4930-a0d1-7ba5a8aede09 for instance acca3424-5f32-44c3-8c4c-fae78593ac50 on hv-cinder-84718 Jun 24 16:42:42.939989 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [req-369b3935-998d-430a-ba39-7d18f214096f req-8b42def7-9283-4eb4-8732-5bb7259fd0a6 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046646 Jun 24 16:42:42.940582 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 462/914] 10.222.0.18 () {64 vars in 1317 bytes} [Fri Jun 24 16:42:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 16:42:42.981314 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-0e849ed2-2111-48d5-901d-80d658bee080 tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65d11cab328748d5a8f5e55eb439e334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901fbc33d59d49f8afa7f06d62e19e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:42:42.990442 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-0e849ed2-2111-48d5-901d-80d658bee080 tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] 10.222.0.18 "GET /compute/v2.1/servers/acca3424-5f32-44c3-8c4c-fae78593ac50" status: 200 len: 1390 microversion: 2.1 time: 0.156726 Jun 24 16:42:42.991103 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 453/915] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:42:42 2022] GET /compute/v2.1/servers/acca3424-5f32-44c3-8c4c-fae78593ac50 => generated 1390 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 16:42:44.011823 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-87a927fd-73ec-4dee-9f2d-fff6ab1b24db tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Calling method '>' {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:42:44.012425 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-87a927fd-73ec-4dee-9f2d-fff6ab1b24db tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] [instance: acca3424-5f32-44c3-8c4c-fae78593ac50] Fetching instance by UUID {{(pid=102148) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:42:44.020536 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-87a927fd-73ec-4dee-9f2d-fff6ab1b24db tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:42:44.020981 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-87a927fd-73ec-4dee-9f2d-fff6ab1b24db tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:42:44.021745 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-87a927fd-73ec-4dee-9f2d-fff6ab1b24db tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:42:44.022177 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-87a927fd-73ec-4dee-9f2d-fff6ab1b24db tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:42:44.070527 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.wsgi [None req-87a927fd-73ec-4dee-9f2d-fff6ab1b24db tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] HTTP exception thrown: Instance acca3424-5f32-44c3-8c4c-fae78593ac50 could not be found. Jun 24 16:42:44.071152 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-87a927fd-73ec-4dee-9f2d-fff6ab1b24db tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Returning 404 to user: Instance acca3424-5f32-44c3-8c4c-fae78593ac50 could not be found. {{(pid=102148) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jun 24 16:42:44.071971 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-87a927fd-73ec-4dee-9f2d-fff6ab1b24db tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] 10.222.0.18 "GET /compute/v2.1/servers/acca3424-5f32-44c3-8c4c-fae78593ac50" status: 404 len: 111 microversion: 2.1 time: 0.064575 Jun 24 16:42:44.072517 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 463/916] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:42:44 2022] GET /compute/v2.1/servers/acca3424-5f32-44c3-8c4c-fae78593ac50 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 16:42:44.930974 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-d999d7b6-32d0-46ab-8ae0-9576dddfff0e tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Calling method '>' {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:42:44.931490 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-d999d7b6-32d0-46ab-8ae0-9576dddfff0e tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] [instance: 2b6c814b-481d-4fba-8cd7-c84aee3f7572] Fetching instance by UUID {{(pid=102149) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:42:44.938780 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-d999d7b6-32d0-46ab-8ae0-9576dddfff0e tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:42:44.939224 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-d999d7b6-32d0-46ab-8ae0-9576dddfff0e tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:42:44.939980 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-d999d7b6-32d0-46ab-8ae0-9576dddfff0e tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:42:44.940411 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-d999d7b6-32d0-46ab-8ae0-9576dddfff0e tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:42:44.992515 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.wsgi [None req-d999d7b6-32d0-46ab-8ae0-9576dddfff0e tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] HTTP exception thrown: Instance 2b6c814b-481d-4fba-8cd7-c84aee3f7572 could not be found. Jun 24 16:42:44.993103 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-d999d7b6-32d0-46ab-8ae0-9576dddfff0e tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Returning 404 to user: Instance 2b6c814b-481d-4fba-8cd7-c84aee3f7572 could not be found. {{(pid=102149) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jun 24 16:42:44.993921 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-d999d7b6-32d0-46ab-8ae0-9576dddfff0e tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] 10.222.0.18 "DELETE /compute/v2.1/servers/2b6c814b-481d-4fba-8cd7-c84aee3f7572" status: 404 len: 111 microversion: 2.1 time: 0.066888 Jun 24 16:42:44.994463 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 454/917] 10.222.0.18 () {58 vars in 1238 bytes} [Fri Jun 24 16:42:44 2022] DELETE /compute/v2.1/servers/2b6c814b-481d-4fba-8cd7-c84aee3f7572 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 16:42:45.002614 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-ffeca05f-a9ff-4bcc-a22c-f3171f631afb tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Calling method '>' {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:42:45.003254 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-ffeca05f-a9ff-4bcc-a22c-f3171f631afb tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] [instance: 2b6c814b-481d-4fba-8cd7-c84aee3f7572] Fetching instance by UUID {{(pid=102148) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:42:45.010562 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-ffeca05f-a9ff-4bcc-a22c-f3171f631afb tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:42:45.010978 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-ffeca05f-a9ff-4bcc-a22c-f3171f631afb tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:42:45.011750 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-ffeca05f-a9ff-4bcc-a22c-f3171f631afb tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:42:45.012225 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-ffeca05f-a9ff-4bcc-a22c-f3171f631afb tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:42:45.061288 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.wsgi [None req-ffeca05f-a9ff-4bcc-a22c-f3171f631afb tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] HTTP exception thrown: Instance 2b6c814b-481d-4fba-8cd7-c84aee3f7572 could not be found. Jun 24 16:42:45.061878 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-ffeca05f-a9ff-4bcc-a22c-f3171f631afb tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Returning 404 to user: Instance 2b6c814b-481d-4fba-8cd7-c84aee3f7572 could not be found. {{(pid=102148) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jun 24 16:42:45.062723 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-ffeca05f-a9ff-4bcc-a22c-f3171f631afb tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] 10.222.0.18 "GET /compute/v2.1/servers/2b6c814b-481d-4fba-8cd7-c84aee3f7572" status: 404 len: 111 microversion: 2.1 time: 0.063848 Jun 24 16:42:45.063258 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 464/918] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:42:44 2022] GET /compute/v2.1/servers/2b6c814b-481d-4fba-8cd7-c84aee3f7572 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 16:42:46.486378 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-c0698671-16bc-485a-bc40-4ab453693980 tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] Calling method '.version_select at 0x7f1ae2fec940>' {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:42:46.504566 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-c0698671-16bc-485a-bc40-4ab453693980 tempest-TestVolumeBootPattern-476763070 tempest-TestVolumeBootPattern-476763070-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-306670203" status: 202 len: 0 microversion: 2.1 time: 0.021852 Jun 24 16:42:46.505129 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 455/919] 10.222.0.18 () {58 vars in 1259 bytes} [Fri Jun 24 16:42:46 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-306670203 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 24 16:43:12.266886 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-bea2fb69-732f-45a4-8b66-d7c29ae51445 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Calling method '>' {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:43:12.267809 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-bea2fb69-732f-45a4-8b66-d7c29ae51445 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] [instance: bbc30718-1530-42df-bb08-c3418a02180f] Fetching instance by UUID {{(pid=102148) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:43:12.275145 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-bea2fb69-732f-45a4-8b66-d7c29ae51445 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:43:12.275590 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-bea2fb69-732f-45a4-8b66-d7c29ae51445 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:43:12.276346 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-bea2fb69-732f-45a4-8b66-d7c29ae51445 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:43:12.276774 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-bea2fb69-732f-45a4-8b66-d7c29ae51445 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:43:12.341342 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-bea2fb69-732f-45a4-8b66-d7c29ae51445 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] 10.222.0.18 "GET /compute/v2.1/servers/bbc30718-1530-42df-bb08-c3418a02180f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.078960 Jun 24 16:43:12.341891 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 465/920] 10.222.0.18 () {58 vars in 1301 bytes} [Fri Jun 24 16:43:12 2022] GET /compute/v2.1/servers/bbc30718-1530-42df-bb08-c3418a02180f/os-volume_attachments => generated 25 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 24 16:43:12.427905 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-a00a8ac8-8483-4bf7-80d8-c4e8a81a6a7f tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Calling method '>' {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:43:12.428399 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-a00a8ac8-8483-4bf7-80d8-c4e8a81a6a7f tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] [instance: bbc30718-1530-42df-bb08-c3418a02180f] Fetching instance by UUID {{(pid=102149) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:43:12.437098 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-a00a8ac8-8483-4bf7-80d8-c4e8a81a6a7f tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:43:12.437488 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-a00a8ac8-8483-4bf7-80d8-c4e8a81a6a7f tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:43:12.438259 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-a00a8ac8-8483-4bf7-80d8-c4e8a81a6a7f tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:43:12.438716 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-a00a8ac8-8483-4bf7-80d8-c4e8a81a6a7f tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:43:12.499235 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-a00a8ac8-8483-4bf7-80d8-c4e8a81a6a7f tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] [instance: bbc30718-1530-42df-bb08-c3418a02180f] Going to try to terminate instance {{(pid=102149) delete /opt/stack/nova/nova/compute/api.py:2562}} Jun 24 16:43:12.611687 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-a00a8ac8-8483-4bf7-80d8-c4e8a81a6a7f tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] 10.222.0.18 "DELETE /compute/v2.1/servers/bbc30718-1530-42df-bb08-c3418a02180f" status: 204 len: 0 microversion: 2.1 time: 0.187192 Jun 24 16:43:12.612417 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 456/921] 10.222.0.18 () {58 vars in 1238 bytes} [Fri Jun 24 16:43:12 2022] DELETE /compute/v2.1/servers/bbc30718-1530-42df-bb08-c3418a02180f => generated 0 bytes in 189 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 24 16:43:12.620581 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-59930468-b33a-49a5-9bcd-15f1d256bb05 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Calling method '>' {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:43:12.621274 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-59930468-b33a-49a5-9bcd-15f1d256bb05 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] [instance: bbc30718-1530-42df-bb08-c3418a02180f] Fetching instance by UUID {{(pid=102148) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:43:12.629165 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-59930468-b33a-49a5-9bcd-15f1d256bb05 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:43:12.629608 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-59930468-b33a-49a5-9bcd-15f1d256bb05 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:43:12.630370 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-59930468-b33a-49a5-9bcd-15f1d256bb05 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:43:12.630936 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-59930468-b33a-49a5-9bcd-15f1d256bb05 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:43:12.832994 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-59930468-b33a-49a5-9bcd-15f1d256bb05 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5ba17c9390249878062ee1b003e9d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b03d0f5f955c49f48e6f06aaa5aae5f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:43:12.841113 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-59930468-b33a-49a5-9bcd-15f1d256bb05 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] 10.222.0.18 "GET /compute/v2.1/servers/bbc30718-1530-42df-bb08-c3418a02180f" status: 200 len: 1672 microversion: 2.1 time: 0.224164 Jun 24 16:43:12.841666 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 466/922] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:43:12 2022] GET /compute/v2.1/servers/bbc30718-1530-42df-bb08-c3418a02180f => generated 1672 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 16:43:13.859544 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-4aaf1cf5-2dee-4a0a-9472-4fd0442fc2e7 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Calling method '>' {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:43:13.860242 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-4aaf1cf5-2dee-4a0a-9472-4fd0442fc2e7 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] [instance: bbc30718-1530-42df-bb08-c3418a02180f] Fetching instance by UUID {{(pid=102149) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:43:13.867526 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-4aaf1cf5-2dee-4a0a-9472-4fd0442fc2e7 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:43:13.867957 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-4aaf1cf5-2dee-4a0a-9472-4fd0442fc2e7 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:43:13.868723 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-4aaf1cf5-2dee-4a0a-9472-4fd0442fc2e7 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:43:13.869153 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-4aaf1cf5-2dee-4a0a-9472-4fd0442fc2e7 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:43:14.071098 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-4aaf1cf5-2dee-4a0a-9472-4fd0442fc2e7 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5ba17c9390249878062ee1b003e9d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b03d0f5f955c49f48e6f06aaa5aae5f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:43:14.079420 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-4aaf1cf5-2dee-4a0a-9472-4fd0442fc2e7 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] 10.222.0.18 "GET /compute/v2.1/servers/bbc30718-1530-42df-bb08-c3418a02180f" status: 200 len: 1672 microversion: 2.1 time: 0.224790 Jun 24 16:43:14.079978 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 457/923] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:43:13 2022] GET /compute/v2.1/servers/bbc30718-1530-42df-bb08-c3418a02180f => generated 1672 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 16:43:15.097073 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-f21f06d5-9a26-4abe-af78-9f910e4120b6 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Calling method '>' {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:43:15.097666 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-f21f06d5-9a26-4abe-af78-9f910e4120b6 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] [instance: bbc30718-1530-42df-bb08-c3418a02180f] Fetching instance by UUID {{(pid=102148) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:43:15.105144 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-f21f06d5-9a26-4abe-af78-9f910e4120b6 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:43:15.105593 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-f21f06d5-9a26-4abe-af78-9f910e4120b6 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:43:15.106360 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-f21f06d5-9a26-4abe-af78-9f910e4120b6 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:43:15.106953 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-f21f06d5-9a26-4abe-af78-9f910e4120b6 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:43:15.314268 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-f21f06d5-9a26-4abe-af78-9f910e4120b6 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5ba17c9390249878062ee1b003e9d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b03d0f5f955c49f48e6f06aaa5aae5f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:43:15.323025 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-f21f06d5-9a26-4abe-af78-9f910e4120b6 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] 10.222.0.18 "GET /compute/v2.1/servers/bbc30718-1530-42df-bb08-c3418a02180f" status: 200 len: 1672 microversion: 2.1 time: 0.229676 Jun 24 16:43:15.323862 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 467/924] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:43:15 2022] GET /compute/v2.1/servers/bbc30718-1530-42df-bb08-c3418a02180f => generated 1672 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 16:43:15.934207 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [req-16a3080f-3898-47ee-82ef-fbacd24a48f0 req-59857cb0-2482-44d9-9720-0c0ef19b566a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bbc30718-1530-42df-bb08-c3418a02180f", "name": "network-vif-deleted", "tag": "42daa041-fdc0-4dfb-bf9b-d0e86576ac6d"}]} {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 16:43:15.936334 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 24 16:43:15.936334 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: warnings.warn(msg) Jun 24 16:43:15.946217 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [req-16a3080f-3898-47ee-82ef-fbacd24a48f0 req-59857cb0-2482-44d9-9720-0c0ef19b566a service nova] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:43:15.946680 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [req-16a3080f-3898-47ee-82ef-fbacd24a48f0 req-59857cb0-2482-44d9-9720-0c0ef19b566a service nova] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:43:16.115440 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.compute.server_external_events [req-16a3080f-3898-47ee-82ef-fbacd24a48f0 req-59857cb0-2482-44d9-9720-0c0ef19b566a service nova] Creating event network-vif-deleted:42daa041-fdc0-4dfb-bf9b-d0e86576ac6d for instance bbc30718-1530-42df-bb08-c3418a02180f on hv-cinder-84718 Jun 24 16:43:16.120183 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [req-16a3080f-3898-47ee-82ef-fbacd24a48f0 req-59857cb0-2482-44d9-9720-0c0ef19b566a service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.189619 Jun 24 16:43:16.121249 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 458/925] 10.222.0.18 () {64 vars in 1317 bytes} [Fri Jun 24 16:43:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 16:43:16.341808 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-c7c20fa8-2f63-4f84-9cf5-e916d4d7e1b2 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Calling method '>' {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:43:16.343223 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-c7c20fa8-2f63-4f84-9cf5-e916d4d7e1b2 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] [instance: bbc30718-1530-42df-bb08-c3418a02180f] Fetching instance by UUID {{(pid=102148) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:43:16.362404 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-c7c20fa8-2f63-4f84-9cf5-e916d4d7e1b2 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:43:16.363771 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-c7c20fa8-2f63-4f84-9cf5-e916d4d7e1b2 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:43:16.365004 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-c7c20fa8-2f63-4f84-9cf5-e916d4d7e1b2 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:43:16.365664 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-c7c20fa8-2f63-4f84-9cf5-e916d4d7e1b2 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:43:16.449368 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-c7c20fa8-2f63-4f84-9cf5-e916d4d7e1b2 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:43:16.449813 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-c7c20fa8-2f63-4f84-9cf5-e916d4d7e1b2 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:43:16.450260 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.objects.instance [None req-c7c20fa8-2f63-4f84-9cf5-e916d4d7e1b2 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Lazy-loading 'fault' on Instance uuid bbc30718-1530-42df-bb08-c3418a02180f {{(pid=102148) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Jun 24 16:43:16.517859 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-c7c20fa8-2f63-4f84-9cf5-e916d4d7e1b2 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5ba17c9390249878062ee1b003e9d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b03d0f5f955c49f48e6f06aaa5aae5f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:43:16.527952 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-c7c20fa8-2f63-4f84-9cf5-e916d4d7e1b2 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] 10.222.0.18 "GET /compute/v2.1/servers/bbc30718-1530-42df-bb08-c3418a02180f" status: 200 len: 1326 microversion: 2.1 time: 0.190306 Jun 24 16:43:16.528564 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 468/926] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:43:16 2022] GET /compute/v2.1/servers/bbc30718-1530-42df-bb08-c3418a02180f => generated 1326 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 16:43:17.545605 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-14f64c05-6878-4867-bea8-d31959979802 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Calling method '>' {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:43:17.546287 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-14f64c05-6878-4867-bea8-d31959979802 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] [instance: bbc30718-1530-42df-bb08-c3418a02180f] Fetching instance by UUID {{(pid=102149) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:43:17.553691 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-14f64c05-6878-4867-bea8-d31959979802 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:43:17.554134 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-14f64c05-6878-4867-bea8-d31959979802 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:43:17.554934 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-14f64c05-6878-4867-bea8-d31959979802 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:43:17.555360 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-14f64c05-6878-4867-bea8-d31959979802 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:43:17.604257 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.wsgi [None req-14f64c05-6878-4867-bea8-d31959979802 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] HTTP exception thrown: Instance bbc30718-1530-42df-bb08-c3418a02180f could not be found. Jun 24 16:43:17.604747 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-14f64c05-6878-4867-bea8-d31959979802 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Returning 404 to user: Instance bbc30718-1530-42df-bb08-c3418a02180f could not be found. {{(pid=102149) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jun 24 16:43:17.605568 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-14f64c05-6878-4867-bea8-d31959979802 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] 10.222.0.18 "GET /compute/v2.1/servers/bbc30718-1530-42df-bb08-c3418a02180f" status: 404 len: 111 microversion: 2.1 time: 0.064782 Jun 24 16:43:17.606107 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 459/927] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:43:17 2022] GET /compute/v2.1/servers/bbc30718-1530-42df-bb08-c3418a02180f => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 16:43:17.615337 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-c972e8b2-650b-4d90-a54b-efe76ce0e6e2 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Calling method '.version_select at 0x7f1ae80efca0>' {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:43:17.632548 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-c972e8b2-650b-4d90-a54b-efe76ce0e6e2 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1116509597" status: 202 len: 0 microversion: 2.1 time: 0.020794 Jun 24 16:43:17.633114 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 469/928] 10.222.0.18 () {58 vars in 1220 bytes} [Fri Jun 24 16:43:17 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1116509597 => generated 0 bytes in 22 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 24 16:43:18.625201 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-79c06c75-c938-4317-a879-b18832d41f6e tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Action: 'create', calling method: .version_select at 0x7f1ae8da98b0>, body: {"keypair": {"name": "tempest-keypair-1341805629", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAiboCk/nghn7JUwDW5tS0/T8xaXETA/0eKzmL/rAMMwqo/cmlRwrIhQOcTS03J5RBITapowwyCN2zYXnTz4YHOPdLTstCTA7pivuGt+87wmafG73WIfzU0mpB/Q0PjUjA=="}} {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 16:43:18.646221 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.quota [None req-79c06c75-c938-4317-a879-b18832d41f6e tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Getting quotas for project b03d0f5f955c49f48e6f06aaa5aae5f4. Resources: {'key_pairs'} {{(pid=102149) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jun 24 16:43:18.649989 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.quota [None req-79c06c75-c938-4317-a879-b18832d41f6e tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Getting quotas for user a5ba17c9390249878062ee1b003e9d3a and project b03d0f5f955c49f48e6f06aaa5aae5f4. Resources: {'key_pairs'} {{(pid=102149) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jun 24 16:43:18.675474 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-79c06c75-c938-4317-a879-b18832d41f6e tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.054665 Jun 24 16:43:18.676056 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 460/929] 10.222.0.18 () {60 vars in 1158 bytes} [Fri Jun 24 16:43:18 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 16:43:20.445171 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-39cf113a-ec6e-4766-8b4e-e3c3bdfab004 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1790497350", "imageRef": "113c9cfb-6cee-4018-9e63-66fae82b3851", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f2bcec95-87e3-41fe-8d12-671e0679c896"}], "security_groups": [{"name": "tempest-securitygroup--333396608"}], "key_name": "tempest-keypair-1341805629", "user_data": "}} {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 16:43:20.572192 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.network.neutron [None req-39cf113a-ec6e-4766-8b4e-e3c3bdfab004 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] validate_networks() for [('f2bcec95-87e3-41fe-8d12-671e0679c896', None, None, None)] {{(pid=102148) validate_networks /opt/stack/nova/nova/network/neutron.py:2367}} Jun 24 16:43:21.238113 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.virt.hardware [None req-39cf113a-ec6e-4766-8b4e-e3c3bdfab004 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Flavor limits 0:0:0 {{(pid=102148) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 24 16:43:21.238666 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.virt.hardware [None req-39cf113a-ec6e-4766-8b4e-e3c3bdfab004 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Image limits 0:0:0 {{(pid=102148) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 24 16:43:21.239181 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.virt.hardware [None req-39cf113a-ec6e-4766-8b4e-e3c3bdfab004 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Flavor pref 0:0:0 {{(pid=102148) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 24 16:43:21.239623 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.virt.hardware [None req-39cf113a-ec6e-4766-8b4e-e3c3bdfab004 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Image pref 0:0:0 {{(pid=102148) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 24 16:43:21.240035 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.virt.hardware [None req-39cf113a-ec6e-4766-8b4e-e3c3bdfab004 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=102148) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 24 16:43:21.249142 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-39cf113a-ec6e-4766-8b4e-e3c3bdfab004 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:43:21.249595 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-39cf113a-ec6e-4766-8b4e-e3c3bdfab004 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:43:21.250428 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-39cf113a-ec6e-4766-8b4e-e3c3bdfab004 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:43:21.250899 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-39cf113a-ec6e-4766-8b4e-e3c3bdfab004 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:43:21.268388 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.quota [None req-39cf113a-ec6e-4766-8b4e-e3c3bdfab004 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Getting quotas for project b03d0f5f955c49f48e6f06aaa5aae5f4. Resources: {'ram', 'instances', 'cores'} {{(pid=102148) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jun 24 16:43:21.272321 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.quota [None req-39cf113a-ec6e-4766-8b4e-e3c3bdfab004 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Getting quotas for user a5ba17c9390249878062ee1b003e9d3a and project b03d0f5f955c49f48e6f06aaa5aae5f4. Resources: {'ram', 'instances', 'cores'} {{(pid=102148) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jun 24 16:43:21.282830 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-39cf113a-ec6e-4766-8b4e-e3c3bdfab004 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Going to run 1 instances... {{(pid=102148) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Jun 24 16:43:21.285124 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-39cf113a-ec6e-4766-8b4e-e3c3bdfab004 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] [instance: d7e889d0-7da4-4e56-86c6-356cc3c3b08c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='113c9cfb-6cee-4018-9e63-66fae82b3851',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=102148) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1684}} Jun 24 16:43:21.329009 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: ERROR oslo.messaging._drivers.impl_rabbit [None req-39cf113a-ec6e-4766-8b4e-e3c3bdfab004 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] [70905e20-fa5f-4414-9c8e-b5c3523990e5] AMQP server on 10.222.0.18:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jun 24 16:43:22.336397 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO oslo.messaging._drivers.impl_rabbit [None req-39cf113a-ec6e-4766-8b4e-e3c3bdfab004 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] [70905e20-fa5f-4414-9c8e-b5c3523990e5] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 59042. Jun 24 16:43:22.340469 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-39cf113a-ec6e-4766-8b4e-e3c3bdfab004 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.899565 Jun 24 16:43:22.341711 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 470/930] 10.222.0.18 () {60 vars in 1146 bytes} [Fri Jun 24 16:43:20 2022] POST /compute/v2.1/servers => generated 401 bytes in 1901 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 24 16:43:22.351895 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-9d0fb0a4-5294-4479-86f1-0b2be7a6b910 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Calling method '>' {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:43:22.352497 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-9d0fb0a4-5294-4479-86f1-0b2be7a6b910 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] [instance: d7e889d0-7da4-4e56-86c6-356cc3c3b08c] Fetching instance by UUID {{(pid=102149) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:43:22.431572 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-9d0fb0a4-5294-4479-86f1-0b2be7a6b910 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5ba17c9390249878062ee1b003e9d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b03d0f5f955c49f48e6f06aaa5aae5f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:43:22.438885 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-9d0fb0a4-5294-4479-86f1-0b2be7a6b910 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] 10.222.0.18 "GET /compute/v2.1/servers/d7e889d0-7da4-4e56-86c6-356cc3c3b08c" status: 200 len: 1238 microversion: 2.1 time: 0.090788 Jun 24 16:43:22.439442 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 461/931] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:43:22 2022] GET /compute/v2.1/servers/d7e889d0-7da4-4e56-86c6-356cc3c3b08c => generated 1238 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 16:43:23.455365 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-648bc9a1-4406-49bc-94a7-d4125c710e51 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Calling method '>' {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:43:23.455965 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-648bc9a1-4406-49bc-94a7-d4125c710e51 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] [instance: d7e889d0-7da4-4e56-86c6-356cc3c3b08c] Fetching instance by UUID {{(pid=102148) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:43:23.467881 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-648bc9a1-4406-49bc-94a7-d4125c710e51 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:43:23.468419 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-648bc9a1-4406-49bc-94a7-d4125c710e51 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:43:23.469357 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-648bc9a1-4406-49bc-94a7-d4125c710e51 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:43:23.469909 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-648bc9a1-4406-49bc-94a7-d4125c710e51 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:43:23.601803 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-648bc9a1-4406-49bc-94a7-d4125c710e51 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5ba17c9390249878062ee1b003e9d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b03d0f5f955c49f48e6f06aaa5aae5f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:43:23.611231 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-648bc9a1-4406-49bc-94a7-d4125c710e51 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] 10.222.0.18 "GET /compute/v2.1/servers/d7e889d0-7da4-4e56-86c6-356cc3c3b08c" status: 200 len: 1298 microversion: 2.1 time: 0.159803 Jun 24 16:43:23.615196 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 471/932] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:43:23 2022] GET /compute/v2.1/servers/d7e889d0-7da4-4e56-86c6-356cc3c3b08c => generated 1298 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 16:43:24.629105 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-53b86e0a-404a-467d-abac-3df6db81db0a tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Calling method '>' {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:43:24.629720 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-53b86e0a-404a-467d-abac-3df6db81db0a tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] [instance: d7e889d0-7da4-4e56-86c6-356cc3c3b08c] Fetching instance by UUID {{(pid=102149) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:43:24.637410 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-53b86e0a-404a-467d-abac-3df6db81db0a tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:43:24.637870 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-53b86e0a-404a-467d-abac-3df6db81db0a tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:43:24.638652 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-53b86e0a-404a-467d-abac-3df6db81db0a tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:43:24.639119 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-53b86e0a-404a-467d-abac-3df6db81db0a tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:43:24.848799 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-53b86e0a-404a-467d-abac-3df6db81db0a tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5ba17c9390249878062ee1b003e9d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b03d0f5f955c49f48e6f06aaa5aae5f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:43:24.857599 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-53b86e0a-404a-467d-abac-3df6db81db0a tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] 10.222.0.18 "GET /compute/v2.1/servers/d7e889d0-7da4-4e56-86c6-356cc3c3b08c" status: 200 len: 1363 microversion: 2.1 time: 0.232177 Jun 24 16:43:24.858249 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 462/933] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:43:24 2022] GET /compute/v2.1/servers/d7e889d0-7da4-4e56-86c6-356cc3c3b08c => generated 1363 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 16:43:25.489186 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [req-5a8642a9-0955-4beb-8255-8faf44382f87 req-0ef0a4ed-a5f2-4a39-95ab-734bff20775c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d7e889d0-7da4-4e56-86c6-356cc3c3b08c", "tag": "7ca301f0-0aac-4149-acf4-678c9a818b7d"}]} {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 16:43:25.491312 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 24 16:43:25.491312 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: warnings.warn(msg) Jun 24 16:43:25.511812 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [req-5a8642a9-0955-4beb-8255-8faf44382f87 req-0ef0a4ed-a5f2-4a39-95ab-734bff20775c service nova] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:43:25.512245 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [req-5a8642a9-0955-4beb-8255-8faf44382f87 req-0ef0a4ed-a5f2-4a39-95ab-734bff20775c service nova] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:43:25.529410 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.compute.server_external_events [req-5a8642a9-0955-4beb-8255-8faf44382f87 req-0ef0a4ed-a5f2-4a39-95ab-734bff20775c service nova] Creating event network-changed:7ca301f0-0aac-4149-acf4-678c9a818b7d for instance d7e889d0-7da4-4e56-86c6-356cc3c3b08c on hv-cinder-84718 Jun 24 16:43:25.534582 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [req-5a8642a9-0955-4beb-8255-8faf44382f87 req-0ef0a4ed-a5f2-4a39-95ab-734bff20775c service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050129 Jun 24 16:43:25.535213 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 472/934] 10.222.0.18 () {64 vars in 1317 bytes} [Fri Jun 24 16:43:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 16:43:25.873934 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-ddd97aec-540c-4745-9851-24209d6f782d tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Calling method '>' {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:43:25.874700 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-ddd97aec-540c-4745-9851-24209d6f782d tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] [instance: d7e889d0-7da4-4e56-86c6-356cc3c3b08c] Fetching instance by UUID {{(pid=102149) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:43:25.882213 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-ddd97aec-540c-4745-9851-24209d6f782d tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:43:25.882599 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-ddd97aec-540c-4745-9851-24209d6f782d tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:43:25.883415 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-ddd97aec-540c-4745-9851-24209d6f782d tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:43:25.883858 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-ddd97aec-540c-4745-9851-24209d6f782d tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:43:26.091950 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-ddd97aec-540c-4745-9851-24209d6f782d tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5ba17c9390249878062ee1b003e9d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b03d0f5f955c49f48e6f06aaa5aae5f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:43:26.100044 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-ddd97aec-540c-4745-9851-24209d6f782d tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] 10.222.0.18 "GET /compute/v2.1/servers/d7e889d0-7da4-4e56-86c6-356cc3c3b08c" status: 200 len: 1363 microversion: 2.1 time: 0.229978 Jun 24 16:43:26.100599 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 463/935] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:43:25 2022] GET /compute/v2.1/servers/d7e889d0-7da4-4e56-86c6-356cc3c3b08c => generated 1363 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 16:43:27.117846 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-311dfe18-5102-4e27-bb45-0f00cdc64837 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Calling method '>' {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:43:27.118469 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-311dfe18-5102-4e27-bb45-0f00cdc64837 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] [instance: d7e889d0-7da4-4e56-86c6-356cc3c3b08c] Fetching instance by UUID {{(pid=102148) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:43:27.126882 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-311dfe18-5102-4e27-bb45-0f00cdc64837 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:43:27.127341 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-311dfe18-5102-4e27-bb45-0f00cdc64837 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:43:27.128123 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-311dfe18-5102-4e27-bb45-0f00cdc64837 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:43:27.128564 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-311dfe18-5102-4e27-bb45-0f00cdc64837 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:43:27.333055 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-311dfe18-5102-4e27-bb45-0f00cdc64837 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5ba17c9390249878062ee1b003e9d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b03d0f5f955c49f48e6f06aaa5aae5f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:43:27.341474 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-311dfe18-5102-4e27-bb45-0f00cdc64837 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] 10.222.0.18 "GET /compute/v2.1/servers/d7e889d0-7da4-4e56-86c6-356cc3c3b08c" status: 200 len: 1363 microversion: 2.1 time: 0.227768 Jun 24 16:43:27.342106 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 473/936] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:43:27 2022] GET /compute/v2.1/servers/d7e889d0-7da4-4e56-86c6-356cc3c3b08c => generated 1363 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 16:43:28.358617 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-679d234e-4bb2-4979-95b3-94e3c5c6f1d3 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Calling method '>' {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:43:28.359250 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-679d234e-4bb2-4979-95b3-94e3c5c6f1d3 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] [instance: d7e889d0-7da4-4e56-86c6-356cc3c3b08c] Fetching instance by UUID {{(pid=102149) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:43:28.366598 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-679d234e-4bb2-4979-95b3-94e3c5c6f1d3 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:43:28.367068 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-679d234e-4bb2-4979-95b3-94e3c5c6f1d3 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:43:28.367952 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-679d234e-4bb2-4979-95b3-94e3c5c6f1d3 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:43:28.368384 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-679d234e-4bb2-4979-95b3-94e3c5c6f1d3 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:43:28.570334 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-679d234e-4bb2-4979-95b3-94e3c5c6f1d3 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5ba17c9390249878062ee1b003e9d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b03d0f5f955c49f48e6f06aaa5aae5f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:43:28.579240 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-679d234e-4bb2-4979-95b3-94e3c5c6f1d3 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] 10.222.0.18 "GET /compute/v2.1/servers/d7e889d0-7da4-4e56-86c6-356cc3c3b08c" status: 200 len: 1363 microversion: 2.1 time: 0.224903 Jun 24 16:43:28.579797 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 464/937] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:43:28 2022] GET /compute/v2.1/servers/d7e889d0-7da4-4e56-86c6-356cc3c3b08c => generated 1363 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 16:43:29.596377 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-d591739f-e248-4082-b0c8-88c79b0817fe tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Calling method '>' {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:43:29.596961 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-d591739f-e248-4082-b0c8-88c79b0817fe tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] [instance: d7e889d0-7da4-4e56-86c6-356cc3c3b08c] Fetching instance by UUID {{(pid=102148) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:43:29.604107 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-d591739f-e248-4082-b0c8-88c79b0817fe tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:43:29.604558 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-d591739f-e248-4082-b0c8-88c79b0817fe tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:43:29.605319 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-d591739f-e248-4082-b0c8-88c79b0817fe tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:43:29.605833 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-d591739f-e248-4082-b0c8-88c79b0817fe tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:43:29.821289 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-d591739f-e248-4082-b0c8-88c79b0817fe tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5ba17c9390249878062ee1b003e9d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b03d0f5f955c49f48e6f06aaa5aae5f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:43:29.829714 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-d591739f-e248-4082-b0c8-88c79b0817fe tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] 10.222.0.18 "GET /compute/v2.1/servers/d7e889d0-7da4-4e56-86c6-356cc3c3b08c" status: 200 len: 1363 microversion: 2.1 time: 0.237019 Jun 24 16:43:29.830270 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 474/938] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:43:29 2022] GET /compute/v2.1/servers/d7e889d0-7da4-4e56-86c6-356cc3c3b08c => generated 1363 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 16:43:30.845588 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-7ea7117a-5b18-4988-9202-514b12226255 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Calling method '>' {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:43:30.846205 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-7ea7117a-5b18-4988-9202-514b12226255 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] [instance: d7e889d0-7da4-4e56-86c6-356cc3c3b08c] Fetching instance by UUID {{(pid=102149) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:43:30.853559 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-7ea7117a-5b18-4988-9202-514b12226255 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:43:30.854016 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-7ea7117a-5b18-4988-9202-514b12226255 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:43:30.854816 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-7ea7117a-5b18-4988-9202-514b12226255 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:43:30.855253 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-7ea7117a-5b18-4988-9202-514b12226255 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:43:31.058417 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-7ea7117a-5b18-4988-9202-514b12226255 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5ba17c9390249878062ee1b003e9d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b03d0f5f955c49f48e6f06aaa5aae5f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:43:31.070255 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-7ea7117a-5b18-4988-9202-514b12226255 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] 10.222.0.18 "GET /compute/v2.1/servers/d7e889d0-7da4-4e56-86c6-356cc3c3b08c" status: 200 len: 1363 microversion: 2.1 time: 0.227999 Jun 24 16:43:31.071194 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 465/939] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:43:30 2022] GET /compute/v2.1/servers/d7e889d0-7da4-4e56-86c6-356cc3c3b08c => generated 1363 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 16:43:31.936971 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [req-6cf4331a-e64b-4117-9f5a-10f1a7200157 req-3fb94542-99f1-4268-92a3-c863756ea1a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d7e889d0-7da4-4e56-86c6-356cc3c3b08c", "name": "network-vif-plugged", "status": "completed", "tag": "7ca301f0-0aac-4149-acf4-678c9a818b7d"}]} {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 16:43:31.938472 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 24 16:43:31.938472 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: warnings.warn(msg) Jun 24 16:43:31.946554 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [req-6cf4331a-e64b-4117-9f5a-10f1a7200157 req-3fb94542-99f1-4268-92a3-c863756ea1a0 service nova] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:43:31.947024 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [req-6cf4331a-e64b-4117-9f5a-10f1a7200157 req-3fb94542-99f1-4268-92a3-c863756ea1a0 service nova] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:43:31.962460 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.compute.server_external_events [req-6cf4331a-e64b-4117-9f5a-10f1a7200157 req-3fb94542-99f1-4268-92a3-c863756ea1a0 service nova] Creating event network-vif-plugged:7ca301f0-0aac-4149-acf4-678c9a818b7d for instance d7e889d0-7da4-4e56-86c6-356cc3c3b08c on hv-cinder-84718 Jun 24 16:43:31.967972 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [req-6cf4331a-e64b-4117-9f5a-10f1a7200157 req-3fb94542-99f1-4268-92a3-c863756ea1a0 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.209053 Jun 24 16:43:31.968591 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 475/940] 10.222.0.18 () {64 vars in 1317 bytes} [Fri Jun 24 16:43:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 16:43:32.089582 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-401fb9f5-29ad-4113-a290-7b87c5fc8b1d tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Calling method '>' {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:43:32.090332 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-401fb9f5-29ad-4113-a290-7b87c5fc8b1d tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] [instance: d7e889d0-7da4-4e56-86c6-356cc3c3b08c] Fetching instance by UUID {{(pid=102149) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:43:32.098838 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-401fb9f5-29ad-4113-a290-7b87c5fc8b1d tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:43:32.099413 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-401fb9f5-29ad-4113-a290-7b87c5fc8b1d tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:43:32.100219 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-401fb9f5-29ad-4113-a290-7b87c5fc8b1d tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:43:32.100850 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-401fb9f5-29ad-4113-a290-7b87c5fc8b1d tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:43:32.307223 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-401fb9f5-29ad-4113-a290-7b87c5fc8b1d tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5ba17c9390249878062ee1b003e9d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b03d0f5f955c49f48e6f06aaa5aae5f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:43:32.315287 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-401fb9f5-29ad-4113-a290-7b87c5fc8b1d tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] 10.222.0.18 "GET /compute/v2.1/servers/d7e889d0-7da4-4e56-86c6-356cc3c3b08c" status: 200 len: 1363 microversion: 2.1 time: 0.230129 Jun 24 16:43:32.315842 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 466/941] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:43:32 2022] GET /compute/v2.1/servers/d7e889d0-7da4-4e56-86c6-356cc3c3b08c => generated 1363 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 16:43:33.332740 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-6fcb656d-8417-4e47-b9dd-d93eecc1e174 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Calling method '>' {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:43:33.334108 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-6fcb656d-8417-4e47-b9dd-d93eecc1e174 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] [instance: d7e889d0-7da4-4e56-86c6-356cc3c3b08c] Fetching instance by UUID {{(pid=102148) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:43:33.342032 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-6fcb656d-8417-4e47-b9dd-d93eecc1e174 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:43:33.342503 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-6fcb656d-8417-4e47-b9dd-d93eecc1e174 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:43:33.343292 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-6fcb656d-8417-4e47-b9dd-d93eecc1e174 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:43:33.343749 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-6fcb656d-8417-4e47-b9dd-d93eecc1e174 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:43:33.550183 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-6fcb656d-8417-4e47-b9dd-d93eecc1e174 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5ba17c9390249878062ee1b003e9d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b03d0f5f955c49f48e6f06aaa5aae5f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:43:33.558326 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-6fcb656d-8417-4e47-b9dd-d93eecc1e174 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] 10.222.0.18 "GET /compute/v2.1/servers/d7e889d0-7da4-4e56-86c6-356cc3c3b08c" status: 200 len: 1363 microversion: 2.1 time: 0.229752 Jun 24 16:43:33.558974 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 476/942] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:43:33 2022] GET /compute/v2.1/servers/d7e889d0-7da4-4e56-86c6-356cc3c3b08c => generated 1363 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 16:43:34.574894 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-2bd974e5-4e9d-4d56-84fc-5ffb56411562 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Calling method '>' {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:43:34.575489 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-2bd974e5-4e9d-4d56-84fc-5ffb56411562 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] [instance: d7e889d0-7da4-4e56-86c6-356cc3c3b08c] Fetching instance by UUID {{(pid=102149) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:43:34.582916 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-2bd974e5-4e9d-4d56-84fc-5ffb56411562 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:43:34.583359 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-2bd974e5-4e9d-4d56-84fc-5ffb56411562 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:43:34.584114 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-2bd974e5-4e9d-4d56-84fc-5ffb56411562 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:43:34.584544 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-2bd974e5-4e9d-4d56-84fc-5ffb56411562 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:43:34.783315 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-2bd974e5-4e9d-4d56-84fc-5ffb56411562 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5ba17c9390249878062ee1b003e9d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b03d0f5f955c49f48e6f06aaa5aae5f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:43:34.791465 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-2bd974e5-4e9d-4d56-84fc-5ffb56411562 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] 10.222.0.18 "GET /compute/v2.1/servers/d7e889d0-7da4-4e56-86c6-356cc3c3b08c" status: 200 len: 1548 microversion: 2.1 time: 0.220202 Jun 24 16:43:34.792027 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 467/943] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:43:34 2022] GET /compute/v2.1/servers/d7e889d0-7da4-4e56-86c6-356cc3c3b08c => generated 1548 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 16:43:34.808159 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-e886f71e-c3cd-46f9-9ea8-b16e479ab006 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Calling method '>' {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:43:34.808671 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-e886f71e-c3cd-46f9-9ea8-b16e479ab006 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] [instance: d7e889d0-7da4-4e56-86c6-356cc3c3b08c] Fetching instance by UUID {{(pid=102148) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:43:34.815830 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-e886f71e-c3cd-46f9-9ea8-b16e479ab006 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:43:34.816274 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-e886f71e-c3cd-46f9-9ea8-b16e479ab006 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:43:34.817033 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-e886f71e-c3cd-46f9-9ea8-b16e479ab006 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:43:34.817463 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-e886f71e-c3cd-46f9-9ea8-b16e479ab006 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:43:35.064981 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-e886f71e-c3cd-46f9-9ea8-b16e479ab006 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] 10.222.0.18 "GET /compute/v2.1/servers/d7e889d0-7da4-4e56-86c6-356cc3c3b08c/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.260407 Jun 24 16:43:35.065571 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 477/944] 10.222.0.18 () {58 vars in 1274 bytes} [Fri Jun 24 16:43:34 2022] GET /compute/v2.1/servers/d7e889d0-7da4-4e56-86c6-356cc3c3b08c/os-interface => generated 284 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 16:43:36.625290 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [req-53e50428-026c-4212-bb16-c7a9cbcb9228 req-5a79d0eb-a12b-4fda-aab0-08819e09872a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d7e889d0-7da4-4e56-86c6-356cc3c3b08c", "tag": "7ca301f0-0aac-4149-acf4-678c9a818b7d"}]} {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 16:43:36.626997 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 24 16:43:36.626997 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: warnings.warn(msg) Jun 24 16:43:36.635903 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [req-53e50428-026c-4212-bb16-c7a9cbcb9228 req-5a79d0eb-a12b-4fda-aab0-08819e09872a service nova] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:43:36.636344 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [req-53e50428-026c-4212-bb16-c7a9cbcb9228 req-5a79d0eb-a12b-4fda-aab0-08819e09872a service nova] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:43:36.653562 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.compute.server_external_events [req-53e50428-026c-4212-bb16-c7a9cbcb9228 req-5a79d0eb-a12b-4fda-aab0-08819e09872a service nova] Creating event network-changed:7ca301f0-0aac-4149-acf4-678c9a818b7d for instance d7e889d0-7da4-4e56-86c6-356cc3c3b08c on hv-cinder-84718 Jun 24 16:43:36.658817 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [req-53e50428-026c-4212-bb16-c7a9cbcb9228 req-5a79d0eb-a12b-4fda-aab0-08819e09872a service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037266 Jun 24 16:43:36.659837 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 468/945] 10.222.0.18 () {64 vars in 1317 bytes} [Fri Jun 24 16:43:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 16:44:10.723616 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: ERROR oslo.messaging._drivers.impl_rabbit [-] [632a0803-aad0-438e-9ad9-ad6bce2a0ccf] AMQP server on 10.222.0.18:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jun 24 16:44:10.726771 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-e07bda13-28ad-4fbe-a253-d7bfae63397e tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Calling method '>' {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:44:10.727254 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-e07bda13-28ad-4fbe-a253-d7bfae63397e tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] [instance: d7e889d0-7da4-4e56-86c6-356cc3c3b08c] Fetching instance by UUID {{(pid=102148) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:44:10.734981 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-e07bda13-28ad-4fbe-a253-d7bfae63397e tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:44:10.735424 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-e07bda13-28ad-4fbe-a253-d7bfae63397e tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:44:10.736388 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-e07bda13-28ad-4fbe-a253-d7bfae63397e tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:44:10.736847 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-e07bda13-28ad-4fbe-a253-d7bfae63397e tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:44:10.794069 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-e07bda13-28ad-4fbe-a253-d7bfae63397e tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] 10.222.0.18 "GET /compute/v2.1/servers/d7e889d0-7da4-4e56-86c6-356cc3c3b08c/ips" status: 200 len: 145 microversion: 2.1 time: 0.072002 Jun 24 16:44:10.794635 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 478/946] 10.222.0.18 () {58 vars in 1247 bytes} [Fri Jun 24 16:44:10 2022] GET /compute/v2.1/servers/d7e889d0-7da4-4e56-86c6-356cc3c3b08c/ips => generated 145 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 16:44:12.247011 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-06e4c43a-9189-42a2-9985-cb4c513a2b06 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "cc07da3a-bdb7-444a-a904-e8ebbe8e7e3f"}} {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 16:44:12.248150 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-06e4c43a-9189-42a2-9985-cb4c513a2b06 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] [instance: d7e889d0-7da4-4e56-86c6-356cc3c3b08c] Fetching instance by UUID {{(pid=102149) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:44:12.255621 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-06e4c43a-9189-42a2-9985-cb4c513a2b06 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:44:12.256069 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-06e4c43a-9189-42a2-9985-cb4c513a2b06 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:44:12.256850 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-06e4c43a-9189-42a2-9985-cb4c513a2b06 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:44:12.257307 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-06e4c43a-9189-42a2-9985-cb4c513a2b06 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:44:12.612366 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-06e4c43a-9189-42a2-9985-cb4c513a2b06 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] 10.222.0.18 "POST /compute/v2.1/servers/d7e889d0-7da4-4e56-86c6-356cc3c3b08c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.370535 Jun 24 16:44:12.612958 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 469/947] 10.222.0.18 () {60 vars in 1322 bytes} [Fri Jun 24 16:44:12 2022] POST /compute/v2.1/servers/d7e889d0-7da4-4e56-86c6-356cc3c3b08c/os-volume_attachments => generated 194 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 16:44:19.286654 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-b4927c7b-e3c1-4137-8b2d-f0a47a6e2613 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Calling method '>' {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:44:19.287602 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-b4927c7b-e3c1-4137-8b2d-f0a47a6e2613 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] [instance: d7e889d0-7da4-4e56-86c6-356cc3c3b08c] Fetching instance by UUID {{(pid=102148) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:44:19.297833 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-b4927c7b-e3c1-4137-8b2d-f0a47a6e2613 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:44:19.298272 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-b4927c7b-e3c1-4137-8b2d-f0a47a6e2613 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:44:19.299084 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-b4927c7b-e3c1-4137-8b2d-f0a47a6e2613 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:44:19.299525 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-b4927c7b-e3c1-4137-8b2d-f0a47a6e2613 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:44:19.351792 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO oslo.messaging._drivers.impl_rabbit [-] [632a0803-aad0-438e-9ad9-ad6bce2a0ccf] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 59152. Jun 24 16:44:19.369610 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-b4927c7b-e3c1-4137-8b2d-f0a47a6e2613 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] 10.222.0.18 "GET /compute/v2.1/servers/d7e889d0-7da4-4e56-86c6-356cc3c3b08c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.086648 Jun 24 16:44:19.370757 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 479/948] 10.222.0.18 () {58 vars in 1301 bytes} [Fri Jun 24 16:44:19 2022] GET /compute/v2.1/servers/d7e889d0-7da4-4e56-86c6-356cc3c3b08c/os-volume_attachments => generated 197 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 16:44:19.381509 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-5ff5c63e-c977-4f5d-87fd-e6b08a2b5705 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Calling method '>' {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:44:19.382080 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-5ff5c63e-c977-4f5d-87fd-e6b08a2b5705 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] [instance: d7e889d0-7da4-4e56-86c6-356cc3c3b08c] Fetching instance by UUID {{(pid=102149) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:44:19.390244 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-5ff5c63e-c977-4f5d-87fd-e6b08a2b5705 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:44:19.390714 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-5ff5c63e-c977-4f5d-87fd-e6b08a2b5705 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:44:19.391487 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-5ff5c63e-c977-4f5d-87fd-e6b08a2b5705 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:44:19.391951 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-5ff5c63e-c977-4f5d-87fd-e6b08a2b5705 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:44:19.457327 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-5ff5c63e-c977-4f5d-87fd-e6b08a2b5705 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] 10.222.0.18 "GET /compute/v2.1/servers/d7e889d0-7da4-4e56-86c6-356cc3c3b08c/os-volume_attachments/cc07da3a-bdb7-444a-a904-e8ebbe8e7e3f" status: 200 len: 194 microversion: 2.1 time: 0.080332 Jun 24 16:44:19.457819 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 470/949] 10.222.0.18 () {58 vars in 1412 bytes} [Fri Jun 24 16:44:19 2022] GET /compute/v2.1/servers/d7e889d0-7da4-4e56-86c6-356cc3c3b08c/os-volume_attachments/cc07da3a-bdb7-444a-a904-e8ebbe8e7e3f => generated 194 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 16:44:20.907849 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-d60d7bef-1558-495d-a2c9-441ae4b847c0 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "bb7a1747-569e-4e44-b8fd-b5ec5aed874c"}} {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 16:44:20.908908 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-d60d7bef-1558-495d-a2c9-441ae4b847c0 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] [instance: d7e889d0-7da4-4e56-86c6-356cc3c3b08c] Fetching instance by UUID {{(pid=102148) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:44:20.916100 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-d60d7bef-1558-495d-a2c9-441ae4b847c0 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:44:20.916601 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-d60d7bef-1558-495d-a2c9-441ae4b847c0 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:44:20.917359 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-d60d7bef-1558-495d-a2c9-441ae4b847c0 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:44:20.917794 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-d60d7bef-1558-495d-a2c9-441ae4b847c0 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:44:21.255832 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-d60d7bef-1558-495d-a2c9-441ae4b847c0 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] 10.222.0.18 "POST /compute/v2.1/servers/d7e889d0-7da4-4e56-86c6-356cc3c3b08c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.351544 Jun 24 16:44:21.256434 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 480/950] 10.222.0.18 () {60 vars in 1322 bytes} [Fri Jun 24 16:44:20 2022] POST /compute/v2.1/servers/d7e889d0-7da4-4e56-86c6-356cc3c3b08c/os-volume_attachments => generated 194 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 16:44:29.013309 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-69a82cac-b241-41fc-9dc2-192052ae695e tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Calling method '>' {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:44:29.014232 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-69a82cac-b241-41fc-9dc2-192052ae695e tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] [instance: d7e889d0-7da4-4e56-86c6-356cc3c3b08c] Fetching instance by UUID {{(pid=102149) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:44:29.021805 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-69a82cac-b241-41fc-9dc2-192052ae695e tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:44:29.022255 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-69a82cac-b241-41fc-9dc2-192052ae695e tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:44:29.023050 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-69a82cac-b241-41fc-9dc2-192052ae695e tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:44:29.023482 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-69a82cac-b241-41fc-9dc2-192052ae695e tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:44:29.088497 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-69a82cac-b241-41fc-9dc2-192052ae695e tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] 10.222.0.18 "GET /compute/v2.1/servers/d7e889d0-7da4-4e56-86c6-356cc3c3b08c/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.078369 Jun 24 16:44:29.089046 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 471/951] 10.222.0.18 () {58 vars in 1301 bytes} [Fri Jun 24 16:44:29 2022] GET /compute/v2.1/servers/d7e889d0-7da4-4e56-86c6-356cc3c3b08c/os-volume_attachments => generated 371 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 16:44:29.231522 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-2e068199-f84d-494d-89b7-78d32682e343 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Calling method '>' {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:44:29.232259 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-2e068199-f84d-494d-89b7-78d32682e343 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] [instance: d7e889d0-7da4-4e56-86c6-356cc3c3b08c] Fetching instance by UUID {{(pid=102148) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:44:29.240349 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-2e068199-f84d-494d-89b7-78d32682e343 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:44:29.240790 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-2e068199-f84d-494d-89b7-78d32682e343 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:44:29.241546 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-2e068199-f84d-494d-89b7-78d32682e343 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:44:29.242065 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-2e068199-f84d-494d-89b7-78d32682e343 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:44:29.306383 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-2e068199-f84d-494d-89b7-78d32682e343 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] 10.222.0.18 "GET /compute/v2.1/servers/d7e889d0-7da4-4e56-86c6-356cc3c3b08c/os-volume_attachments/cc07da3a-bdb7-444a-a904-e8ebbe8e7e3f" status: 200 len: 194 microversion: 2.1 time: 0.079649 Jun 24 16:44:29.307001 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 481/952] 10.222.0.18 () {58 vars in 1412 bytes} [Fri Jun 24 16:44:29 2022] GET /compute/v2.1/servers/d7e889d0-7da4-4e56-86c6-356cc3c3b08c/os-volume_attachments/cc07da3a-bdb7-444a-a904-e8ebbe8e7e3f => generated 194 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 16:44:29.317500 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-c4604dfe-be07-4914-ace0-ca94ccec5e1c tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Calling method '>' {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:44:29.317981 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-c4604dfe-be07-4914-ace0-ca94ccec5e1c tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] [instance: d7e889d0-7da4-4e56-86c6-356cc3c3b08c] Fetching instance by UUID {{(pid=102149) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:44:29.326313 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-c4604dfe-be07-4914-ace0-ca94ccec5e1c tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:44:29.326783 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-c4604dfe-be07-4914-ace0-ca94ccec5e1c tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:44:29.327550 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-c4604dfe-be07-4914-ace0-ca94ccec5e1c tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:44:29.327978 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-c4604dfe-be07-4914-ace0-ca94ccec5e1c tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:44:29.475903 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.objects.instance [None req-c4604dfe-be07-4914-ace0-ca94ccec5e1c tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Lazy-loading 'services' on Instance uuid d7e889d0-7da4-4e56-86c6-356cc3c3b08c {{(pid=102149) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Jun 24 16:44:29.620351 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-c4604dfe-be07-4914-ace0-ca94ccec5e1c tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] 10.222.0.18 "DELETE /compute/v2.1/servers/d7e889d0-7da4-4e56-86c6-356cc3c3b08c/os-volume_attachments/cc07da3a-bdb7-444a-a904-e8ebbe8e7e3f" status: 202 len: 0 microversion: 2.1 time: 0.306538 Jun 24 16:44:29.620982 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 472/953] 10.222.0.18 () {58 vars in 1415 bytes} [Fri Jun 24 16:44:29 2022] DELETE /compute/v2.1/servers/d7e889d0-7da4-4e56-86c6-356cc3c3b08c/os-volume_attachments/cc07da3a-bdb7-444a-a904-e8ebbe8e7e3f => generated 0 bytes in 309 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 24 16:44:30.794885 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-1ca06b4e-454f-43a6-8a1e-7ce8e3c6aff9 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Calling method '>' {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:44:30.795422 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-1ca06b4e-454f-43a6-8a1e-7ce8e3c6aff9 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] [instance: d7e889d0-7da4-4e56-86c6-356cc3c3b08c] Fetching instance by UUID {{(pid=102148) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:44:30.802597 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-1ca06b4e-454f-43a6-8a1e-7ce8e3c6aff9 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:44:30.803011 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-1ca06b4e-454f-43a6-8a1e-7ce8e3c6aff9 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:44:30.803757 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-1ca06b4e-454f-43a6-8a1e-7ce8e3c6aff9 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:44:30.804186 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-1ca06b4e-454f-43a6-8a1e-7ce8e3c6aff9 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:44:30.870000 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-1ca06b4e-454f-43a6-8a1e-7ce8e3c6aff9 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] 10.222.0.18 "GET /compute/v2.1/servers/d7e889d0-7da4-4e56-86c6-356cc3c3b08c/os-volume_attachments/bb7a1747-569e-4e44-b8fd-b5ec5aed874c" status: 200 len: 194 microversion: 2.1 time: 0.078864 Jun 24 16:44:30.870578 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 482/954] 10.222.0.18 () {58 vars in 1412 bytes} [Fri Jun 24 16:44:30 2022] GET /compute/v2.1/servers/d7e889d0-7da4-4e56-86c6-356cc3c3b08c/os-volume_attachments/bb7a1747-569e-4e44-b8fd-b5ec5aed874c => generated 194 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 16:44:30.880756 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-47e0485a-9a86-4a53-9b16-25583338bc91 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Calling method '>' {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:44:30.881329 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-47e0485a-9a86-4a53-9b16-25583338bc91 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] [instance: d7e889d0-7da4-4e56-86c6-356cc3c3b08c] Fetching instance by UUID {{(pid=102149) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:44:30.889320 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-47e0485a-9a86-4a53-9b16-25583338bc91 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:44:30.889762 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-47e0485a-9a86-4a53-9b16-25583338bc91 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:44:30.890536 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-47e0485a-9a86-4a53-9b16-25583338bc91 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:44:30.890990 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-47e0485a-9a86-4a53-9b16-25583338bc91 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:44:31.040948 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.objects.instance [None req-47e0485a-9a86-4a53-9b16-25583338bc91 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Lazy-loading 'services' on Instance uuid d7e889d0-7da4-4e56-86c6-356cc3c3b08c {{(pid=102149) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Jun 24 16:44:31.177974 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-47e0485a-9a86-4a53-9b16-25583338bc91 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] 10.222.0.18 "DELETE /compute/v2.1/servers/d7e889d0-7da4-4e56-86c6-356cc3c3b08c/os-volume_attachments/bb7a1747-569e-4e44-b8fd-b5ec5aed874c" status: 202 len: 0 microversion: 2.1 time: 0.301216 Jun 24 16:44:31.178547 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 473/955] 10.222.0.18 () {58 vars in 1415 bytes} [Fri Jun 24 16:44:30 2022] DELETE /compute/v2.1/servers/d7e889d0-7da4-4e56-86c6-356cc3c3b08c/os-volume_attachments/bb7a1747-569e-4e44-b8fd-b5ec5aed874c => generated 0 bytes in 303 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 24 16:44:32.429430 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-31697bac-dcf6-4a1a-9bc8-5cd935939c24 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Calling method '>' {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:44:32.430442 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-31697bac-dcf6-4a1a-9bc8-5cd935939c24 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] [instance: d7e889d0-7da4-4e56-86c6-356cc3c3b08c] Fetching instance by UUID {{(pid=102148) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:44:32.438057 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-31697bac-dcf6-4a1a-9bc8-5cd935939c24 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:44:32.438504 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-31697bac-dcf6-4a1a-9bc8-5cd935939c24 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:44:32.439311 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-31697bac-dcf6-4a1a-9bc8-5cd935939c24 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:44:32.439742 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-31697bac-dcf6-4a1a-9bc8-5cd935939c24 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:44:32.504296 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-31697bac-dcf6-4a1a-9bc8-5cd935939c24 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] 10.222.0.18 "GET /compute/v2.1/servers/d7e889d0-7da4-4e56-86c6-356cc3c3b08c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.078537 Jun 24 16:44:32.504851 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 483/956] 10.222.0.18 () {58 vars in 1301 bytes} [Fri Jun 24 16:44:32 2022] GET /compute/v2.1/servers/d7e889d0-7da4-4e56-86c6-356cc3c3b08c/os-volume_attachments => generated 25 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 24 16:44:32.677652 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-3ad1ae07-040b-4d89-a0b5-9c7887af55f1 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Calling method '>' {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:44:32.678737 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-3ad1ae07-040b-4d89-a0b5-9c7887af55f1 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] [instance: d7e889d0-7da4-4e56-86c6-356cc3c3b08c] Fetching instance by UUID {{(pid=102149) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:44:32.686786 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-3ad1ae07-040b-4d89-a0b5-9c7887af55f1 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:44:32.687239 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-3ad1ae07-040b-4d89-a0b5-9c7887af55f1 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:44:32.688008 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-3ad1ae07-040b-4d89-a0b5-9c7887af55f1 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:44:32.688443 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-3ad1ae07-040b-4d89-a0b5-9c7887af55f1 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:44:32.752888 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-3ad1ae07-040b-4d89-a0b5-9c7887af55f1 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] 10.222.0.18 "GET /compute/v2.1/servers/d7e889d0-7da4-4e56-86c6-356cc3c3b08c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.079396 Jun 24 16:44:32.753437 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 474/957] 10.222.0.18 () {58 vars in 1301 bytes} [Fri Jun 24 16:44:32 2022] GET /compute/v2.1/servers/d7e889d0-7da4-4e56-86c6-356cc3c3b08c/os-volume_attachments => generated 25 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 24 16:44:32.840466 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-bf4ef963-bc66-45f6-b5d7-76bd51c46b84 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Calling method '>' {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:44:32.840959 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-bf4ef963-bc66-45f6-b5d7-76bd51c46b84 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] [instance: d7e889d0-7da4-4e56-86c6-356cc3c3b08c] Fetching instance by UUID {{(pid=102148) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:44:32.848196 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-bf4ef963-bc66-45f6-b5d7-76bd51c46b84 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:44:32.848643 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-bf4ef963-bc66-45f6-b5d7-76bd51c46b84 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:44:32.849401 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-bf4ef963-bc66-45f6-b5d7-76bd51c46b84 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:44:32.849834 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-bf4ef963-bc66-45f6-b5d7-76bd51c46b84 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:44:32.909745 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-bf4ef963-bc66-45f6-b5d7-76bd51c46b84 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] [instance: d7e889d0-7da4-4e56-86c6-356cc3c3b08c] Going to try to terminate instance {{(pid=102148) delete /opt/stack/nova/nova/compute/api.py:2562}} Jun 24 16:44:33.027359 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-bf4ef963-bc66-45f6-b5d7-76bd51c46b84 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] 10.222.0.18 "DELETE /compute/v2.1/servers/d7e889d0-7da4-4e56-86c6-356cc3c3b08c" status: 204 len: 0 microversion: 2.1 time: 0.190182 Jun 24 16:44:33.027947 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 484/958] 10.222.0.18 () {58 vars in 1238 bytes} [Fri Jun 24 16:44:32 2022] DELETE /compute/v2.1/servers/d7e889d0-7da4-4e56-86c6-356cc3c3b08c => generated 0 bytes in 192 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 24 16:44:33.036434 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-5becb70c-3313-4072-9837-b01d0dad90a9 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Calling method '>' {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:44:33.037052 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-5becb70c-3313-4072-9837-b01d0dad90a9 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] [instance: d7e889d0-7da4-4e56-86c6-356cc3c3b08c] Fetching instance by UUID {{(pid=102149) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:44:33.045748 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-5becb70c-3313-4072-9837-b01d0dad90a9 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:44:33.046259 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-5becb70c-3313-4072-9837-b01d0dad90a9 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:44:33.047067 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-5becb70c-3313-4072-9837-b01d0dad90a9 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:44:33.047499 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-5becb70c-3313-4072-9837-b01d0dad90a9 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:44:33.251678 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-5becb70c-3313-4072-9837-b01d0dad90a9 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5ba17c9390249878062ee1b003e9d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b03d0f5f955c49f48e6f06aaa5aae5f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:44:33.259753 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-5becb70c-3313-4072-9837-b01d0dad90a9 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] 10.222.0.18 "GET /compute/v2.1/servers/d7e889d0-7da4-4e56-86c6-356cc3c3b08c" status: 200 len: 1673 microversion: 2.1 time: 0.227390 Jun 24 16:44:33.260308 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 475/959] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:44:33 2022] GET /compute/v2.1/servers/d7e889d0-7da4-4e56-86c6-356cc3c3b08c => generated 1673 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 16:44:34.277555 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-c86a11cc-4a1f-48bf-9260-797cc670be2b tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Calling method '>' {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:44:34.278252 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-c86a11cc-4a1f-48bf-9260-797cc670be2b tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] [instance: d7e889d0-7da4-4e56-86c6-356cc3c3b08c] Fetching instance by UUID {{(pid=102148) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:44:34.285505 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-c86a11cc-4a1f-48bf-9260-797cc670be2b tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:44:34.285957 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-c86a11cc-4a1f-48bf-9260-797cc670be2b tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:44:34.286748 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-c86a11cc-4a1f-48bf-9260-797cc670be2b tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:44:34.287188 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-c86a11cc-4a1f-48bf-9260-797cc670be2b tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:44:34.501255 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-c86a11cc-4a1f-48bf-9260-797cc670be2b tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5ba17c9390249878062ee1b003e9d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b03d0f5f955c49f48e6f06aaa5aae5f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:44:34.509458 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-c86a11cc-4a1f-48bf-9260-797cc670be2b tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] 10.222.0.18 "GET /compute/v2.1/servers/d7e889d0-7da4-4e56-86c6-356cc3c3b08c" status: 200 len: 1673 microversion: 2.1 time: 0.236027 Jun 24 16:44:34.510015 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 485/960] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:44:34 2022] GET /compute/v2.1/servers/d7e889d0-7da4-4e56-86c6-356cc3c3b08c => generated 1673 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 16:44:35.527253 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-54d70bec-2abd-451f-9f2b-a04ec99e1887 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Calling method '>' {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:44:35.527885 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-54d70bec-2abd-451f-9f2b-a04ec99e1887 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] [instance: d7e889d0-7da4-4e56-86c6-356cc3c3b08c] Fetching instance by UUID {{(pid=102149) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:44:35.538634 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-54d70bec-2abd-451f-9f2b-a04ec99e1887 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:44:35.539352 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-54d70bec-2abd-451f-9f2b-a04ec99e1887 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:44:35.540107 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-54d70bec-2abd-451f-9f2b-a04ec99e1887 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:44:35.540583 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-54d70bec-2abd-451f-9f2b-a04ec99e1887 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:44:35.747049 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-54d70bec-2abd-451f-9f2b-a04ec99e1887 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5ba17c9390249878062ee1b003e9d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b03d0f5f955c49f48e6f06aaa5aae5f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:44:35.755861 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-54d70bec-2abd-451f-9f2b-a04ec99e1887 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] 10.222.0.18 "GET /compute/v2.1/servers/d7e889d0-7da4-4e56-86c6-356cc3c3b08c" status: 200 len: 1673 microversion: 2.1 time: 0.233169 Jun 24 16:44:35.756431 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 476/961] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:44:35 2022] GET /compute/v2.1/servers/d7e889d0-7da4-4e56-86c6-356cc3c3b08c => generated 1673 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 16:44:36.234579 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [req-8dce7c29-8b7e-42d5-b242-12eadcf54492 req-ce1e571a-7050-4e31-b8c0-6b93cf697340 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d7e889d0-7da4-4e56-86c6-356cc3c3b08c", "name": "network-vif-deleted", "tag": "7ca301f0-0aac-4149-acf4-678c9a818b7d"}]} {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 16:44:36.236270 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 24 16:44:36.236270 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: warnings.warn(msg) Jun 24 16:44:36.249906 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [req-8dce7c29-8b7e-42d5-b242-12eadcf54492 req-ce1e571a-7050-4e31-b8c0-6b93cf697340 service nova] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:44:36.250766 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [req-8dce7c29-8b7e-42d5-b242-12eadcf54492 req-ce1e571a-7050-4e31-b8c0-6b93cf697340 service nova] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:44:36.270205 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.compute.server_external_events [req-8dce7c29-8b7e-42d5-b242-12eadcf54492 req-ce1e571a-7050-4e31-b8c0-6b93cf697340 service nova] Creating event network-vif-deleted:7ca301f0-0aac-4149-acf4-678c9a818b7d for instance d7e889d0-7da4-4e56-86c6-356cc3c3b08c on hv-cinder-84718 Jun 24 16:44:36.275778 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [req-8dce7c29-8b7e-42d5-b242-12eadcf54492 req-ce1e571a-7050-4e31-b8c0-6b93cf697340 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046845 Jun 24 16:44:36.276544 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 486/962] 10.222.0.18 () {64 vars in 1317 bytes} [Fri Jun 24 16:44:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 16:44:36.773576 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-565707a3-91de-436a-9396-0131c63d2ec4 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Calling method '>' {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:44:36.774197 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-565707a3-91de-436a-9396-0131c63d2ec4 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] [instance: d7e889d0-7da4-4e56-86c6-356cc3c3b08c] Fetching instance by UUID {{(pid=102149) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:44:36.783527 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-565707a3-91de-436a-9396-0131c63d2ec4 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:44:36.784109 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-565707a3-91de-436a-9396-0131c63d2ec4 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:44:36.785147 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-565707a3-91de-436a-9396-0131c63d2ec4 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:44:36.785554 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-565707a3-91de-436a-9396-0131c63d2ec4 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:44:36.838398 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.wsgi [None req-565707a3-91de-436a-9396-0131c63d2ec4 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] HTTP exception thrown: Instance d7e889d0-7da4-4e56-86c6-356cc3c3b08c could not be found. Jun 24 16:44:36.839339 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-565707a3-91de-436a-9396-0131c63d2ec4 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Returning 404 to user: Instance d7e889d0-7da4-4e56-86c6-356cc3c3b08c could not be found. {{(pid=102149) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jun 24 16:44:36.840184 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-565707a3-91de-436a-9396-0131c63d2ec4 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] 10.222.0.18 "GET /compute/v2.1/servers/d7e889d0-7da4-4e56-86c6-356cc3c3b08c" status: 404 len: 111 microversion: 2.1 time: 0.070678 Jun 24 16:44:36.840740 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 477/963] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:44:36 2022] GET /compute/v2.1/servers/d7e889d0-7da4-4e56-86c6-356cc3c3b08c => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 16:44:36.849577 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-7161b9bb-e85d-439d-af24-cca082fb5fdf tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Calling method '.version_select at 0x7f1ae84d2670>' {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:44:36.867401 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-7161b9bb-e85d-439d-af24-cca082fb5fdf tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1341805629" status: 202 len: 0 microversion: 2.1 time: 0.021843 Jun 24 16:44:36.868092 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 487/964] 10.222.0.18 () {58 vars in 1220 bytes} [Fri Jun 24 16:44:36 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1341805629 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 24 16:44:41.295983 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-5c93fa94-c60e-443f-8da9-09fba9fb1c21 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Calling method '>' {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:44:41.296479 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-5c93fa94-c60e-443f-8da9-09fba9fb1c21 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] [instance: d7e889d0-7da4-4e56-86c6-356cc3c3b08c] Fetching instance by UUID {{(pid=102149) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:44:41.303934 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-5c93fa94-c60e-443f-8da9-09fba9fb1c21 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:44:41.304370 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-5c93fa94-c60e-443f-8da9-09fba9fb1c21 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:44:41.305120 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-5c93fa94-c60e-443f-8da9-09fba9fb1c21 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:44:41.305545 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-5c93fa94-c60e-443f-8da9-09fba9fb1c21 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:44:41.358969 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.wsgi [None req-5c93fa94-c60e-443f-8da9-09fba9fb1c21 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] HTTP exception thrown: Instance d7e889d0-7da4-4e56-86c6-356cc3c3b08c could not be found. Jun 24 16:44:41.359828 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-5c93fa94-c60e-443f-8da9-09fba9fb1c21 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Returning 404 to user: Instance d7e889d0-7da4-4e56-86c6-356cc3c3b08c could not be found. {{(pid=102149) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jun 24 16:44:41.361392 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-5c93fa94-c60e-443f-8da9-09fba9fb1c21 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] 10.222.0.18 "DELETE /compute/v2.1/servers/d7e889d0-7da4-4e56-86c6-356cc3c3b08c" status: 404 len: 111 microversion: 2.1 time: 0.069033 Jun 24 16:44:41.361938 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 478/965] 10.222.0.18 () {58 vars in 1238 bytes} [Fri Jun 24 16:44:41 2022] DELETE /compute/v2.1/servers/d7e889d0-7da4-4e56-86c6-356cc3c3b08c => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 16:44:41.369787 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-999edcb5-f62f-4232-abe5-ba73e08df897 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Calling method '>' {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:44:41.370556 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-999edcb5-f62f-4232-abe5-ba73e08df897 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] [instance: d7e889d0-7da4-4e56-86c6-356cc3c3b08c] Fetching instance by UUID {{(pid=102148) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:44:41.378703 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-999edcb5-f62f-4232-abe5-ba73e08df897 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:44:41.379170 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-999edcb5-f62f-4232-abe5-ba73e08df897 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:44:41.379945 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-999edcb5-f62f-4232-abe5-ba73e08df897 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:44:41.380376 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-999edcb5-f62f-4232-abe5-ba73e08df897 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:44:41.429473 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.wsgi [None req-999edcb5-f62f-4232-abe5-ba73e08df897 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] HTTP exception thrown: Instance d7e889d0-7da4-4e56-86c6-356cc3c3b08c could not be found. Jun 24 16:44:41.430033 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-999edcb5-f62f-4232-abe5-ba73e08df897 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Returning 404 to user: Instance d7e889d0-7da4-4e56-86c6-356cc3c3b08c could not be found. {{(pid=102148) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jun 24 16:44:41.430900 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-999edcb5-f62f-4232-abe5-ba73e08df897 tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] 10.222.0.18 "GET /compute/v2.1/servers/d7e889d0-7da4-4e56-86c6-356cc3c3b08c" status: 404 len: 111 microversion: 2.1 time: 0.064818 Jun 24 16:44:41.431684 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 488/966] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:44:41 2022] GET /compute/v2.1/servers/d7e889d0-7da4-4e56-86c6-356cc3c3b08c => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 16:44:42.650037 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-679e2044-97b6-47f0-8f26-67b89ccbea0a tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Calling method '>' {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:44:42.650612 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-679e2044-97b6-47f0-8f26-67b89ccbea0a tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] [instance: bbc30718-1530-42df-bb08-c3418a02180f] Fetching instance by UUID {{(pid=102149) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:44:42.657862 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-679e2044-97b6-47f0-8f26-67b89ccbea0a tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:44:42.658311 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-679e2044-97b6-47f0-8f26-67b89ccbea0a tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:44:42.659120 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-679e2044-97b6-47f0-8f26-67b89ccbea0a tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:44:42.659557 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-679e2044-97b6-47f0-8f26-67b89ccbea0a tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:44:42.709465 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.wsgi [None req-679e2044-97b6-47f0-8f26-67b89ccbea0a tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] HTTP exception thrown: Instance bbc30718-1530-42df-bb08-c3418a02180f could not be found. Jun 24 16:44:42.710083 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-679e2044-97b6-47f0-8f26-67b89ccbea0a tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Returning 404 to user: Instance bbc30718-1530-42df-bb08-c3418a02180f could not be found. {{(pid=102149) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jun 24 16:44:42.711053 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-679e2044-97b6-47f0-8f26-67b89ccbea0a tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] 10.222.0.18 "DELETE /compute/v2.1/servers/bbc30718-1530-42df-bb08-c3418a02180f" status: 404 len: 111 microversion: 2.1 time: 0.064660 Jun 24 16:44:42.711603 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 479/967] 10.222.0.18 () {58 vars in 1238 bytes} [Fri Jun 24 16:44:42 2022] DELETE /compute/v2.1/servers/bbc30718-1530-42df-bb08-c3418a02180f => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 16:44:42.719448 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-81c33516-b247-4e3d-b234-c1b70cb6565a tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Calling method '>' {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:44:42.720007 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-81c33516-b247-4e3d-b234-c1b70cb6565a tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] [instance: bbc30718-1530-42df-bb08-c3418a02180f] Fetching instance by UUID {{(pid=102148) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:44:42.727158 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-81c33516-b247-4e3d-b234-c1b70cb6565a tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:44:42.727605 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-81c33516-b247-4e3d-b234-c1b70cb6565a tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:44:42.728862 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-81c33516-b247-4e3d-b234-c1b70cb6565a tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:44:42.729285 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-81c33516-b247-4e3d-b234-c1b70cb6565a tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:44:42.780412 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.wsgi [None req-81c33516-b247-4e3d-b234-c1b70cb6565a tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] HTTP exception thrown: Instance bbc30718-1530-42df-bb08-c3418a02180f could not be found. Jun 24 16:44:42.781009 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-81c33516-b247-4e3d-b234-c1b70cb6565a tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] Returning 404 to user: Instance bbc30718-1530-42df-bb08-c3418a02180f could not be found. {{(pid=102148) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jun 24 16:44:42.781813 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-81c33516-b247-4e3d-b234-c1b70cb6565a tempest-AttachVolumeTestJSON-1988887012 tempest-AttachVolumeTestJSON-1988887012-project] 10.222.0.18 "GET /compute/v2.1/servers/bbc30718-1530-42df-bb08-c3418a02180f" status: 404 len: 111 microversion: 2.1 time: 0.066117 Jun 24 16:44:42.782358 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 489/968] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:44:42 2022] GET /compute/v2.1/servers/bbc30718-1530-42df-bb08-c3418a02180f => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 16:44:42.943389 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 24 16:44:42.943629 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: Fri Jun 24 16:44:42 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 24 16:44:49.209913 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-eee44fbd-2fa0-4a4a-ac3e-c468f9cb3b2a tempest-VolumesGetTestJSON-1709365841 tempest-VolumesGetTestJSON-1709365841-project] Action: 'create', calling method: .version_select at 0x7f1ae84deaf0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1905303135", "metadata": {"Type": "work"}}} {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 16:44:49.606929 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-eee44fbd-2fa0-4a4a-ac3e-c468f9cb3b2a tempest-VolumesGetTestJSON-1709365841 tempest-VolumesGetTestJSON-1709365841-project] 10.222.0.18 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 0.552400 Jun 24 16:44:49.607537 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 480/969] 10.222.0.18 () {60 vars in 1155 bytes} [Fri Jun 24 16:44:49 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 554 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jun 24 16:44:49.619104 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-7d174345-175a-40c7-a5a9-2fb26bfeabce tempest-VolumesGetTestJSON-1709365841 tempest-VolumesGetTestJSON-1709365841-project] Calling method '.version_select at 0x7f1ae83f08b0>' {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:44:49.701666 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-7d174345-175a-40c7-a5a9-2fb26bfeabce tempest-VolumesGetTestJSON-1709365841 tempest-VolumesGetTestJSON-1709365841-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/e31b2d7f-8f76-405e-a13a-6b67b165a679" status: 200 len: 353 microversion: 2.1 time: 0.086845 Jun 24 16:44:49.702228 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 490/970] 10.222.0.18 () {58 vars in 1244 bytes} [Fri Jun 24 16:44:49 2022] GET /compute/v2.1/os-volumes/e31b2d7f-8f76-405e-a13a-6b67b165a679 => generated 353 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 16:44:50.716277 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-2a708738-7e8d-4f7b-9680-f0595a6f83ca tempest-VolumesGetTestJSON-1709365841 tempest-VolumesGetTestJSON-1709365841-project] Calling method '.version_select at 0x7f1ae81ac9d0>' {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:44:50.798158 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-2a708738-7e8d-4f7b-9680-f0595a6f83ca tempest-VolumesGetTestJSON-1709365841 tempest-VolumesGetTestJSON-1709365841-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/e31b2d7f-8f76-405e-a13a-6b67b165a679" status: 200 len: 354 microversion: 2.1 time: 0.085607 Jun 24 16:44:50.798743 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 481/971] 10.222.0.18 () {58 vars in 1244 bytes} [Fri Jun 24 16:44:50 2022] GET /compute/v2.1/os-volumes/e31b2d7f-8f76-405e-a13a-6b67b165a679 => generated 354 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 16:44:50.810041 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-53fc4483-88cb-4d0b-a782-5c9f55d6a8a5 tempest-VolumesGetTestJSON-1709365841 tempest-VolumesGetTestJSON-1709365841-project] Calling method '.version_select at 0x7f1ae84d2f70>' {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:44:50.888290 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-53fc4483-88cb-4d0b-a782-5c9f55d6a8a5 tempest-VolumesGetTestJSON-1709365841 tempest-VolumesGetTestJSON-1709365841-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/e31b2d7f-8f76-405e-a13a-6b67b165a679" status: 200 len: 354 microversion: 2.1 time: 0.082260 Jun 24 16:44:50.888855 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 491/972] 10.222.0.18 () {58 vars in 1244 bytes} [Fri Jun 24 16:44:50 2022] GET /compute/v2.1/os-volumes/e31b2d7f-8f76-405e-a13a-6b67b165a679 => generated 354 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 16:44:50.904354 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-5d7b318d-ac93-4665-9403-e08c07ba0402 tempest-VolumesGetTestJSON-1709365841 tempest-VolumesGetTestJSON-1709365841-project] Calling method '.version_select at 0x7f1ae81acb80>' {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:44:50.995154 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-5d7b318d-ac93-4665-9403-e08c07ba0402 tempest-VolumesGetTestJSON-1709365841 tempest-VolumesGetTestJSON-1709365841-project] 10.222.0.18 "DELETE /compute/v2.1/os-volumes/e31b2d7f-8f76-405e-a13a-6b67b165a679" status: 202 len: 0 microversion: 2.1 time: 0.094161 Jun 24 16:44:50.995735 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 482/973] 10.222.0.18 () {58 vars in 1247 bytes} [Fri Jun 24 16:44:50 2022] DELETE /compute/v2.1/os-volumes/e31b2d7f-8f76-405e-a13a-6b67b165a679 => generated 0 bytes in 96 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 24 16:44:51.003603 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-02b1b6c8-107a-45cd-ac14-b616fc5decd0 tempest-VolumesGetTestJSON-1709365841 tempest-VolumesGetTestJSON-1709365841-project] Calling method '.version_select at 0x7f1ae81fbd30>' {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:44:51.087617 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-02b1b6c8-107a-45cd-ac14-b616fc5decd0 tempest-VolumesGetTestJSON-1709365841 tempest-VolumesGetTestJSON-1709365841-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/e31b2d7f-8f76-405e-a13a-6b67b165a679" status: 200 len: 353 microversion: 2.1 time: 0.087558 Jun 24 16:44:51.088176 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 492/974] 10.222.0.18 () {58 vars in 1244 bytes} [Fri Jun 24 16:44:50 2022] GET /compute/v2.1/os-volumes/e31b2d7f-8f76-405e-a13a-6b67b165a679 => generated 353 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 16:44:52.100057 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-23a2ed67-33ff-4d35-8e17-33fb527b1c47 tempest-VolumesGetTestJSON-1709365841 tempest-VolumesGetTestJSON-1709365841-project] Calling method '.version_select at 0x7f1ae80861f0>' {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:44:52.158094 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.wsgi [None req-23a2ed67-33ff-4d35-8e17-33fb527b1c47 tempest-VolumesGetTestJSON-1709365841 tempest-VolumesGetTestJSON-1709365841-project] HTTP exception thrown: Volume e31b2d7f-8f76-405e-a13a-6b67b165a679 could not be found. Jun 24 16:44:52.158717 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-23a2ed67-33ff-4d35-8e17-33fb527b1c47 tempest-VolumesGetTestJSON-1709365841 tempest-VolumesGetTestJSON-1709365841-project] Returning 404 to user: Volume e31b2d7f-8f76-405e-a13a-6b67b165a679 could not be found. {{(pid=102149) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jun 24 16:44:52.159521 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-23a2ed67-33ff-4d35-8e17-33fb527b1c47 tempest-VolumesGetTestJSON-1709365841 tempest-VolumesGetTestJSON-1709365841-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/e31b2d7f-8f76-405e-a13a-6b67b165a679" status: 404 len: 109 microversion: 2.1 time: 0.063208 Jun 24 16:44:52.160052 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 483/975] 10.222.0.18 () {58 vars in 1244 bytes} [Fri Jun 24 16:44:52 2022] GET /compute/v2.1/os-volumes/e31b2d7f-8f76-405e-a13a-6b67b165a679 => generated 109 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 16:45:37.017775 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-7d937bec-6fae-4321-81a6-0dde873e0994 tempest-VolumesNegativeTest-561356048 tempest-VolumesNegativeTest-561356048-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1864501319", "imageRef": "113c9cfb-6cee-4018-9e63-66fae82b3851", "flavorRef": "452"}} {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 16:45:37.080216 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.network.neutron [None req-7d937bec-6fae-4321-81a6-0dde873e0994 tempest-VolumesNegativeTest-561356048 tempest-VolumesNegativeTest-561356048-project] validate_networks() for None {{(pid=102148) validate_networks /opt/stack/nova/nova/network/neutron.py:2367}} Jun 24 16:45:37.428530 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.virt.hardware [None req-7d937bec-6fae-4321-81a6-0dde873e0994 tempest-VolumesNegativeTest-561356048 tempest-VolumesNegativeTest-561356048-project] Flavor limits 0:0:0 {{(pid=102148) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 24 16:45:37.428932 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.virt.hardware [None req-7d937bec-6fae-4321-81a6-0dde873e0994 tempest-VolumesNegativeTest-561356048 tempest-VolumesNegativeTest-561356048-project] Image limits 0:0:0 {{(pid=102148) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 24 16:45:37.429399 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.virt.hardware [None req-7d937bec-6fae-4321-81a6-0dde873e0994 tempest-VolumesNegativeTest-561356048 tempest-VolumesNegativeTest-561356048-project] Flavor pref 0:0:0 {{(pid=102148) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 24 16:45:37.429801 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.virt.hardware [None req-7d937bec-6fae-4321-81a6-0dde873e0994 tempest-VolumesNegativeTest-561356048 tempest-VolumesNegativeTest-561356048-project] Image pref 0:0:0 {{(pid=102148) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 24 16:45:37.430207 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.virt.hardware [None req-7d937bec-6fae-4321-81a6-0dde873e0994 tempest-VolumesNegativeTest-561356048 tempest-VolumesNegativeTest-561356048-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=102148) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 24 16:45:37.438591 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-7d937bec-6fae-4321-81a6-0dde873e0994 tempest-VolumesNegativeTest-561356048 tempest-VolumesNegativeTest-561356048-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:45:37.439064 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-7d937bec-6fae-4321-81a6-0dde873e0994 tempest-VolumesNegativeTest-561356048 tempest-VolumesNegativeTest-561356048-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:45:37.439856 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-7d937bec-6fae-4321-81a6-0dde873e0994 tempest-VolumesNegativeTest-561356048 tempest-VolumesNegativeTest-561356048-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:45:37.440284 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-7d937bec-6fae-4321-81a6-0dde873e0994 tempest-VolumesNegativeTest-561356048 tempest-VolumesNegativeTest-561356048-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:45:37.457637 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.quota [None req-7d937bec-6fae-4321-81a6-0dde873e0994 tempest-VolumesNegativeTest-561356048 tempest-VolumesNegativeTest-561356048-project] Getting quotas for project 64e2dd96fbc344d99f55b84cf7e07a48. Resources: {'ram', 'instances', 'cores'} {{(pid=102148) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jun 24 16:45:37.462438 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.quota [None req-7d937bec-6fae-4321-81a6-0dde873e0994 tempest-VolumesNegativeTest-561356048 tempest-VolumesNegativeTest-561356048-project] Getting quotas for user c68fa38f61cb4b1693697b4e9fe7b112 and project 64e2dd96fbc344d99f55b84cf7e07a48. Resources: {'ram', 'instances', 'cores'} {{(pid=102148) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jun 24 16:45:37.472812 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-7d937bec-6fae-4321-81a6-0dde873e0994 tempest-VolumesNegativeTest-561356048 tempest-VolumesNegativeTest-561356048-project] Going to run 1 instances... {{(pid=102148) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Jun 24 16:45:37.475288 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-7d937bec-6fae-4321-81a6-0dde873e0994 tempest-VolumesNegativeTest-561356048 tempest-VolumesNegativeTest-561356048-project] [instance: fe945b40-1604-4fbe-802e-31eb767fee2b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='113c9cfb-6cee-4018-9e63-66fae82b3851',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=102148) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1684}} Jun 24 16:45:37.520015 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-7d937bec-6fae-4321-81a6-0dde873e0994 tempest-VolumesNegativeTest-561356048 tempest-VolumesNegativeTest-561356048-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.507042 Jun 24 16:45:37.520638 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 493/976] 10.222.0.18 () {60 vars in 1146 bytes} [Fri Jun 24 16:45:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 508 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 24 16:45:37.532461 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-fbb65ffc-d598-44d9-97ae-f16246969fb9 tempest-VolumesNegativeTest-561356048 tempest-VolumesNegativeTest-561356048-project] Calling method '>' {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:45:37.533241 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-fbb65ffc-d598-44d9-97ae-f16246969fb9 tempest-VolumesNegativeTest-561356048 tempest-VolumesNegativeTest-561356048-project] [instance: fe945b40-1604-4fbe-802e-31eb767fee2b] Fetching instance by UUID {{(pid=102149) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:45:37.615734 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-fbb65ffc-d598-44d9-97ae-f16246969fb9 tempest-VolumesNegativeTest-561356048 tempest-VolumesNegativeTest-561356048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c68fa38f61cb4b1693697b4e9fe7b112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e2dd96fbc344d99f55b84cf7e07a48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:45:37.623079 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-fbb65ffc-d598-44d9-97ae-f16246969fb9 tempest-VolumesNegativeTest-561356048 tempest-VolumesNegativeTest-561356048-project] 10.222.0.18 "GET /compute/v2.1/servers/fe945b40-1604-4fbe-802e-31eb767fee2b" status: 200 len: 1215 microversion: 2.1 time: 0.095651 Jun 24 16:45:37.623623 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 484/977] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:45:37 2022] GET /compute/v2.1/servers/fe945b40-1604-4fbe-802e-31eb767fee2b => generated 1215 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 16:45:38.640198 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-d912866f-c399-4890-b1ea-6b4b00830fc9 tempest-VolumesNegativeTest-561356048 tempest-VolumesNegativeTest-561356048-project] Calling method '>' {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:45:38.640743 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-d912866f-c399-4890-b1ea-6b4b00830fc9 tempest-VolumesNegativeTest-561356048 tempest-VolumesNegativeTest-561356048-project] [instance: fe945b40-1604-4fbe-802e-31eb767fee2b] Fetching instance by UUID {{(pid=102148) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:45:38.652786 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-d912866f-c399-4890-b1ea-6b4b00830fc9 tempest-VolumesNegativeTest-561356048 tempest-VolumesNegativeTest-561356048-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:45:38.653614 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-d912866f-c399-4890-b1ea-6b4b00830fc9 tempest-VolumesNegativeTest-561356048 tempest-VolumesNegativeTest-561356048-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:45:38.654733 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-d912866f-c399-4890-b1ea-6b4b00830fc9 tempest-VolumesNegativeTest-561356048 tempest-VolumesNegativeTest-561356048-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:45:38.655373 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-d912866f-c399-4890-b1ea-6b4b00830fc9 tempest-VolumesNegativeTest-561356048 tempest-VolumesNegativeTest-561356048-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:45:38.776645 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-d912866f-c399-4890-b1ea-6b4b00830fc9 tempest-VolumesNegativeTest-561356048 tempest-VolumesNegativeTest-561356048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c68fa38f61cb4b1693697b4e9fe7b112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e2dd96fbc344d99f55b84cf7e07a48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:45:38.784719 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-d912866f-c399-4890-b1ea-6b4b00830fc9 tempest-VolumesNegativeTest-561356048 tempest-VolumesNegativeTest-561356048-project] 10.222.0.18 "GET /compute/v2.1/servers/fe945b40-1604-4fbe-802e-31eb767fee2b" status: 200 len: 1273 microversion: 2.1 time: 0.148338 Jun 24 16:45:38.785278 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 494/978] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:45:38 2022] GET /compute/v2.1/servers/fe945b40-1604-4fbe-802e-31eb767fee2b => generated 1273 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 16:45:39.803664 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-1824dae4-929e-4994-b17d-f01cb361badd tempest-VolumesNegativeTest-561356048 tempest-VolumesNegativeTest-561356048-project] Calling method '>' {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:45:39.805596 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-1824dae4-929e-4994-b17d-f01cb361badd tempest-VolumesNegativeTest-561356048 tempest-VolumesNegativeTest-561356048-project] [instance: fe945b40-1604-4fbe-802e-31eb767fee2b] Fetching instance by UUID {{(pid=102149) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:45:39.813667 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-1824dae4-929e-4994-b17d-f01cb361badd tempest-VolumesNegativeTest-561356048 tempest-VolumesNegativeTest-561356048-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:45:39.814180 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-1824dae4-929e-4994-b17d-f01cb361badd tempest-VolumesNegativeTest-561356048 tempest-VolumesNegativeTest-561356048-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:45:39.815092 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-1824dae4-929e-4994-b17d-f01cb361badd tempest-VolumesNegativeTest-561356048 tempest-VolumesNegativeTest-561356048-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:45:39.815543 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-1824dae4-929e-4994-b17d-f01cb361badd tempest-VolumesNegativeTest-561356048 tempest-VolumesNegativeTest-561356048-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:45:40.024015 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-1824dae4-929e-4994-b17d-f01cb361badd tempest-VolumesNegativeTest-561356048 tempest-VolumesNegativeTest-561356048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c68fa38f61cb4b1693697b4e9fe7b112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e2dd96fbc344d99f55b84cf7e07a48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:45:40.032291 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-1824dae4-929e-4994-b17d-f01cb361badd tempest-VolumesNegativeTest-561356048 tempest-VolumesNegativeTest-561356048-project] 10.222.0.18 "GET /compute/v2.1/servers/fe945b40-1604-4fbe-802e-31eb767fee2b" status: 200 len: 1315 microversion: 2.1 time: 0.232288 Jun 24 16:45:40.032860 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 485/979] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:45:39 2022] GET /compute/v2.1/servers/fe945b40-1604-4fbe-802e-31eb767fee2b => generated 1315 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 16:45:40.591340 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [req-c4d58a76-2b64-4bf0-b4f2-3d38e478c418 req-c7c7de57-2f58-4a5c-b090-30644d207ee1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fe945b40-1604-4fbe-802e-31eb767fee2b", "tag": "b3f2f662-c74d-4cd3-90e7-05e63b3c5b6a"}]} {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 16:45:40.593540 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 24 16:45:40.593540 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: warnings.warn(msg) Jun 24 16:45:40.615604 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [req-c4d58a76-2b64-4bf0-b4f2-3d38e478c418 req-c7c7de57-2f58-4a5c-b090-30644d207ee1 service nova] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:45:40.616051 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [req-c4d58a76-2b64-4bf0-b4f2-3d38e478c418 req-c7c7de57-2f58-4a5c-b090-30644d207ee1 service nova] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:45:40.633334 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.compute.server_external_events [req-c4d58a76-2b64-4bf0-b4f2-3d38e478c418 req-c7c7de57-2f58-4a5c-b090-30644d207ee1 service nova] Creating event network-changed:b3f2f662-c74d-4cd3-90e7-05e63b3c5b6a for instance fe945b40-1604-4fbe-802e-31eb767fee2b on hv-cinder-84718 Jun 24 16:45:40.638827 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [req-c4d58a76-2b64-4bf0-b4f2-3d38e478c418 req-c7c7de57-2f58-4a5c-b090-30644d207ee1 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053646 Jun 24 16:45:40.639429 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 495/980] 10.222.0.18 () {64 vars in 1317 bytes} [Fri Jun 24 16:45:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 16:45:41.049540 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-17692a2a-4be2-4f19-b519-ddd0ab7950bd tempest-VolumesNegativeTest-561356048 tempest-VolumesNegativeTest-561356048-project] Calling method '>' {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:45:41.050152 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-17692a2a-4be2-4f19-b519-ddd0ab7950bd tempest-VolumesNegativeTest-561356048 tempest-VolumesNegativeTest-561356048-project] [instance: fe945b40-1604-4fbe-802e-31eb767fee2b] Fetching instance by UUID {{(pid=102149) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:45:41.057769 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-17692a2a-4be2-4f19-b519-ddd0ab7950bd tempest-VolumesNegativeTest-561356048 tempest-VolumesNegativeTest-561356048-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:45:41.058216 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-17692a2a-4be2-4f19-b519-ddd0ab7950bd tempest-VolumesNegativeTest-561356048 tempest-VolumesNegativeTest-561356048-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:45:41.059010 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-17692a2a-4be2-4f19-b519-ddd0ab7950bd tempest-VolumesNegativeTest-561356048 tempest-VolumesNegativeTest-561356048-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:45:41.059443 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-17692a2a-4be2-4f19-b519-ddd0ab7950bd tempest-VolumesNegativeTest-561356048 tempest-VolumesNegativeTest-561356048-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:45:41.270955 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-17692a2a-4be2-4f19-b519-ddd0ab7950bd tempest-VolumesNegativeTest-561356048 tempest-VolumesNegativeTest-561356048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c68fa38f61cb4b1693697b4e9fe7b112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e2dd96fbc344d99f55b84cf7e07a48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:45:41.279656 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-17692a2a-4be2-4f19-b519-ddd0ab7950bd tempest-VolumesNegativeTest-561356048 tempest-VolumesNegativeTest-561356048-project] 10.222.0.18 "GET /compute/v2.1/servers/fe945b40-1604-4fbe-802e-31eb767fee2b" status: 200 len: 1315 microversion: 2.1 time: 0.233757 Jun 24 16:45:41.280228 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 486/981] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:45:41 2022] GET /compute/v2.1/servers/fe945b40-1604-4fbe-802e-31eb767fee2b => generated 1315 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 16:45:42.298431 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-1722d077-062f-433e-af22-be4096b98093 tempest-VolumesNegativeTest-561356048 tempest-VolumesNegativeTest-561356048-project] Calling method '>' {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:45:42.299139 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-1722d077-062f-433e-af22-be4096b98093 tempest-VolumesNegativeTest-561356048 tempest-VolumesNegativeTest-561356048-project] [instance: fe945b40-1604-4fbe-802e-31eb767fee2b] Fetching instance by UUID {{(pid=102148) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:45:42.307063 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-1722d077-062f-433e-af22-be4096b98093 tempest-VolumesNegativeTest-561356048 tempest-VolumesNegativeTest-561356048-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:45:42.307504 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-1722d077-062f-433e-af22-be4096b98093 tempest-VolumesNegativeTest-561356048 tempest-VolumesNegativeTest-561356048-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:45:42.308255 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-1722d077-062f-433e-af22-be4096b98093 tempest-VolumesNegativeTest-561356048 tempest-VolumesNegativeTest-561356048-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:45:42.308744 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-1722d077-062f-433e-af22-be4096b98093 tempest-VolumesNegativeTest-561356048 tempest-VolumesNegativeTest-561356048-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:45:42.516906 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-1722d077-062f-433e-af22-be4096b98093 tempest-VolumesNegativeTest-561356048 tempest-VolumesNegativeTest-561356048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c68fa38f61cb4b1693697b4e9fe7b112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e2dd96fbc344d99f55b84cf7e07a48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:45:42.525004 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-1722d077-062f-433e-af22-be4096b98093 tempest-VolumesNegativeTest-561356048 tempest-VolumesNegativeTest-561356048-project] 10.222.0.18 "GET /compute/v2.1/servers/fe945b40-1604-4fbe-802e-31eb767fee2b" status: 200 len: 1315 microversion: 2.1 time: 0.231198 Jun 24 16:45:42.525555 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 496/982] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:45:42 2022] GET /compute/v2.1/servers/fe945b40-1604-4fbe-802e-31eb767fee2b => generated 1315 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 16:45:43.542141 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-db264580-a857-40ab-9154-f000c6575c9e tempest-VolumesNegativeTest-561356048 tempest-VolumesNegativeTest-561356048-project] Calling method '>' {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:45:43.542782 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-db264580-a857-40ab-9154-f000c6575c9e tempest-VolumesNegativeTest-561356048 tempest-VolumesNegativeTest-561356048-project] [instance: fe945b40-1604-4fbe-802e-31eb767fee2b] Fetching instance by UUID {{(pid=102149) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:45:43.550672 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-db264580-a857-40ab-9154-f000c6575c9e tempest-VolumesNegativeTest-561356048 tempest-VolumesNegativeTest-561356048-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:45:43.551147 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-db264580-a857-40ab-9154-f000c6575c9e tempest-VolumesNegativeTest-561356048 tempest-VolumesNegativeTest-561356048-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:45:43.551934 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-db264580-a857-40ab-9154-f000c6575c9e tempest-VolumesNegativeTest-561356048 tempest-VolumesNegativeTest-561356048-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:45:43.552369 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-db264580-a857-40ab-9154-f000c6575c9e tempest-VolumesNegativeTest-561356048 tempest-VolumesNegativeTest-561356048-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:45:43.752594 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-db264580-a857-40ab-9154-f000c6575c9e tempest-VolumesNegativeTest-561356048 tempest-VolumesNegativeTest-561356048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c68fa38f61cb4b1693697b4e9fe7b112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e2dd96fbc344d99f55b84cf7e07a48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:45:43.760561 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-db264580-a857-40ab-9154-f000c6575c9e tempest-VolumesNegativeTest-561356048 tempest-VolumesNegativeTest-561356048-project] 10.222.0.18 "GET /compute/v2.1/servers/fe945b40-1604-4fbe-802e-31eb767fee2b" status: 200 len: 1315 microversion: 2.1 time: 0.222830 Jun 24 16:45:43.761116 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 487/983] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:45:43 2022] GET /compute/v2.1/servers/fe945b40-1604-4fbe-802e-31eb767fee2b => generated 1315 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 16:45:44.777365 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-a6808fd5-7d31-41c2-bbd3-d1ede284dfcb tempest-VolumesNegativeTest-561356048 tempest-VolumesNegativeTest-561356048-project] Calling method '>' {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:45:44.777910 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-a6808fd5-7d31-41c2-bbd3-d1ede284dfcb tempest-VolumesNegativeTest-561356048 tempest-VolumesNegativeTest-561356048-project] [instance: fe945b40-1604-4fbe-802e-31eb767fee2b] Fetching instance by UUID {{(pid=102148) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:45:44.785076 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-a6808fd5-7d31-41c2-bbd3-d1ede284dfcb tempest-VolumesNegativeTest-561356048 tempest-VolumesNegativeTest-561356048-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:45:44.785679 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-a6808fd5-7d31-41c2-bbd3-d1ede284dfcb tempest-VolumesNegativeTest-561356048 tempest-VolumesNegativeTest-561356048-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:45:44.786441 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-a6808fd5-7d31-41c2-bbd3-d1ede284dfcb tempest-VolumesNegativeTest-561356048 tempest-VolumesNegativeTest-561356048-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:45:44.786892 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-a6808fd5-7d31-41c2-bbd3-d1ede284dfcb tempest-VolumesNegativeTest-561356048 tempest-VolumesNegativeTest-561356048-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:45:44.984750 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-a6808fd5-7d31-41c2-bbd3-d1ede284dfcb tempest-VolumesNegativeTest-561356048 tempest-VolumesNegativeTest-561356048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c68fa38f61cb4b1693697b4e9fe7b112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e2dd96fbc344d99f55b84cf7e07a48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:45:44.993422 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-a6808fd5-7d31-41c2-bbd3-d1ede284dfcb tempest-VolumesNegativeTest-561356048 tempest-VolumesNegativeTest-561356048-project] 10.222.0.18 "GET /compute/v2.1/servers/fe945b40-1604-4fbe-802e-31eb767fee2b" status: 200 len: 1315 microversion: 2.1 time: 0.219926 Jun 24 16:45:44.993964 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 497/984] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:45:44 2022] GET /compute/v2.1/servers/fe945b40-1604-4fbe-802e-31eb767fee2b => generated 1315 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 16:45:46.009919 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-91c083ba-730b-40cb-b6f7-2d5a2cf7cfac tempest-VolumesNegativeTest-561356048 tempest-VolumesNegativeTest-561356048-project] Calling method '>' {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:45:46.010505 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-91c083ba-730b-40cb-b6f7-2d5a2cf7cfac tempest-VolumesNegativeTest-561356048 tempest-VolumesNegativeTest-561356048-project] [instance: fe945b40-1604-4fbe-802e-31eb767fee2b] Fetching instance by UUID {{(pid=102149) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:45:46.017735 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-91c083ba-730b-40cb-b6f7-2d5a2cf7cfac tempest-VolumesNegativeTest-561356048 tempest-VolumesNegativeTest-561356048-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:45:46.018178 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-91c083ba-730b-40cb-b6f7-2d5a2cf7cfac tempest-VolumesNegativeTest-561356048 tempest-VolumesNegativeTest-561356048-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:45:46.018983 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-91c083ba-730b-40cb-b6f7-2d5a2cf7cfac tempest-VolumesNegativeTest-561356048 tempest-VolumesNegativeTest-561356048-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:45:46.019417 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-91c083ba-730b-40cb-b6f7-2d5a2cf7cfac tempest-VolumesNegativeTest-561356048 tempest-VolumesNegativeTest-561356048-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:45:46.229200 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-91c083ba-730b-40cb-b6f7-2d5a2cf7cfac tempest-VolumesNegativeTest-561356048 tempest-VolumesNegativeTest-561356048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c68fa38f61cb4b1693697b4e9fe7b112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e2dd96fbc344d99f55b84cf7e07a48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:45:46.238094 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-91c083ba-730b-40cb-b6f7-2d5a2cf7cfac tempest-VolumesNegativeTest-561356048 tempest-VolumesNegativeTest-561356048-project] 10.222.0.18 "GET /compute/v2.1/servers/fe945b40-1604-4fbe-802e-31eb767fee2b" status: 200 len: 1315 microversion: 2.1 time: 0.231863 Jun 24 16:45:46.238654 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 488/985] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:45:46 2022] GET /compute/v2.1/servers/fe945b40-1604-4fbe-802e-31eb767fee2b => generated 1315 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 16:45:46.364391 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [req-d48463ee-cf98-4d32-9060-2df880635c8f req-3c70d46d-1ca9-402f-813b-683daceec9bc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe945b40-1604-4fbe-802e-31eb767fee2b", "name": "network-vif-plugged", "status": "completed", "tag": "b3f2f662-c74d-4cd3-90e7-05e63b3c5b6a"}]} {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 16:45:46.367179 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 24 16:45:46.367179 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: warnings.warn(msg) Jun 24 16:45:46.376499 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [req-d48463ee-cf98-4d32-9060-2df880635c8f req-3c70d46d-1ca9-402f-813b-683daceec9bc service nova] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:45:46.377157 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [req-d48463ee-cf98-4d32-9060-2df880635c8f req-3c70d46d-1ca9-402f-813b-683daceec9bc service nova] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:45:46.400258 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.compute.server_external_events [req-d48463ee-cf98-4d32-9060-2df880635c8f req-3c70d46d-1ca9-402f-813b-683daceec9bc service nova] Creating event network-vif-plugged:b3f2f662-c74d-4cd3-90e7-05e63b3c5b6a for instance fe945b40-1604-4fbe-802e-31eb767fee2b on hv-cinder-84718 Jun 24 16:45:46.405239 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [req-d48463ee-cf98-4d32-9060-2df880635c8f req-3c70d46d-1ca9-402f-813b-683daceec9bc service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044601 Jun 24 16:45:46.406168 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 498/986] 10.222.0.18 () {64 vars in 1317 bytes} [Fri Jun 24 16:45:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 16:45:47.254747 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-79e2c95a-d1d2-4149-89bb-36fbd2a3a932 tempest-VolumesNegativeTest-561356048 tempest-VolumesNegativeTest-561356048-project] Calling method '>' {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:45:47.255362 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-79e2c95a-d1d2-4149-89bb-36fbd2a3a932 tempest-VolumesNegativeTest-561356048 tempest-VolumesNegativeTest-561356048-project] [instance: fe945b40-1604-4fbe-802e-31eb767fee2b] Fetching instance by UUID {{(pid=102149) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:45:47.262592 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-79e2c95a-d1d2-4149-89bb-36fbd2a3a932 tempest-VolumesNegativeTest-561356048 tempest-VolumesNegativeTest-561356048-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:45:47.263070 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-79e2c95a-d1d2-4149-89bb-36fbd2a3a932 tempest-VolumesNegativeTest-561356048 tempest-VolumesNegativeTest-561356048-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:45:47.263835 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-79e2c95a-d1d2-4149-89bb-36fbd2a3a932 tempest-VolumesNegativeTest-561356048 tempest-VolumesNegativeTest-561356048-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:45:47.264270 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-79e2c95a-d1d2-4149-89bb-36fbd2a3a932 tempest-VolumesNegativeTest-561356048 tempest-VolumesNegativeTest-561356048-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:45:47.469518 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-79e2c95a-d1d2-4149-89bb-36fbd2a3a932 tempest-VolumesNegativeTest-561356048 tempest-VolumesNegativeTest-561356048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c68fa38f61cb4b1693697b4e9fe7b112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e2dd96fbc344d99f55b84cf7e07a48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:45:47.477835 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-79e2c95a-d1d2-4149-89bb-36fbd2a3a932 tempest-VolumesNegativeTest-561356048 tempest-VolumesNegativeTest-561356048-project] 10.222.0.18 "GET /compute/v2.1/servers/fe945b40-1604-4fbe-802e-31eb767fee2b" status: 200 len: 1315 microversion: 2.1 time: 0.226695 Jun 24 16:45:47.478474 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 489/987] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:45:47 2022] GET /compute/v2.1/servers/fe945b40-1604-4fbe-802e-31eb767fee2b => generated 1315 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 16:45:48.495991 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-cbc54a86-8fcc-4346-8892-b05874745076 tempest-VolumesNegativeTest-561356048 tempest-VolumesNegativeTest-561356048-project] Calling method '>' {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:45:48.496732 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-cbc54a86-8fcc-4346-8892-b05874745076 tempest-VolumesNegativeTest-561356048 tempest-VolumesNegativeTest-561356048-project] [instance: fe945b40-1604-4fbe-802e-31eb767fee2b] Fetching instance by UUID {{(pid=102148) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:45:48.504217 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-cbc54a86-8fcc-4346-8892-b05874745076 tempest-VolumesNegativeTest-561356048 tempest-VolumesNegativeTest-561356048-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:45:48.504663 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-cbc54a86-8fcc-4346-8892-b05874745076 tempest-VolumesNegativeTest-561356048 tempest-VolumesNegativeTest-561356048-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:45:48.505428 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-cbc54a86-8fcc-4346-8892-b05874745076 tempest-VolumesNegativeTest-561356048 tempest-VolumesNegativeTest-561356048-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:45:48.505859 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-cbc54a86-8fcc-4346-8892-b05874745076 tempest-VolumesNegativeTest-561356048 tempest-VolumesNegativeTest-561356048-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:45:48.705327 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-cbc54a86-8fcc-4346-8892-b05874745076 tempest-VolumesNegativeTest-561356048 tempest-VolumesNegativeTest-561356048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c68fa38f61cb4b1693697b4e9fe7b112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e2dd96fbc344d99f55b84cf7e07a48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:45:48.716340 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-cbc54a86-8fcc-4346-8892-b05874745076 tempest-VolumesNegativeTest-561356048 tempest-VolumesNegativeTest-561356048-project] 10.222.0.18 "GET /compute/v2.1/servers/fe945b40-1604-4fbe-802e-31eb767fee2b" status: 200 len: 1464 microversion: 2.1 time: 0.224873 Jun 24 16:45:48.716903 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 499/988] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:45:48 2022] GET /compute/v2.1/servers/fe945b40-1604-4fbe-802e-31eb767fee2b => generated 1464 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 16:45:48.787010 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-d91d8099-bc0a-4586-8432-d566a74aa9fc tempest-VolumesNegativeTest-561356048 tempest-VolumesNegativeTest-561356048-project] Calling method '>' {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:45:48.787010 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-d91d8099-bc0a-4586-8432-d566a74aa9fc tempest-VolumesNegativeTest-561356048 tempest-VolumesNegativeTest-561356048-project] [instance: fe945b40-1604-4fbe-802e-31eb767fee2b] Fetching instance by UUID {{(pid=102149) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:45:48.794567 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-d91d8099-bc0a-4586-8432-d566a74aa9fc tempest-VolumesNegativeTest-561356048 tempest-VolumesNegativeTest-561356048-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:45:48.795049 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-d91d8099-bc0a-4586-8432-d566a74aa9fc tempest-VolumesNegativeTest-561356048 tempest-VolumesNegativeTest-561356048-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:45:48.795814 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-d91d8099-bc0a-4586-8432-d566a74aa9fc tempest-VolumesNegativeTest-561356048 tempest-VolumesNegativeTest-561356048-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:45:48.796248 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-d91d8099-bc0a-4586-8432-d566a74aa9fc tempest-VolumesNegativeTest-561356048 tempest-VolumesNegativeTest-561356048-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:45:48.856389 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-d91d8099-bc0a-4586-8432-d566a74aa9fc tempest-VolumesNegativeTest-561356048 tempest-VolumesNegativeTest-561356048-project] [instance: fe945b40-1604-4fbe-802e-31eb767fee2b] Going to try to terminate instance {{(pid=102149) delete /opt/stack/nova/nova/compute/api.py:2562}} Jun 24 16:45:48.970010 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-d91d8099-bc0a-4586-8432-d566a74aa9fc tempest-VolumesNegativeTest-561356048 tempest-VolumesNegativeTest-561356048-project] 10.222.0.18 "DELETE /compute/v2.1/servers/fe945b40-1604-4fbe-802e-31eb767fee2b" status: 204 len: 0 microversion: 2.1 time: 0.186719 Jun 24 16:45:48.970445 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 490/989] 10.222.0.18 () {58 vars in 1238 bytes} [Fri Jun 24 16:45:48 2022] DELETE /compute/v2.1/servers/fe945b40-1604-4fbe-802e-31eb767fee2b => generated 0 bytes in 188 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 24 16:45:48.979219 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-ef5bab44-1032-4633-b398-28b0714d5c84 tempest-VolumesNegativeTest-561356048 tempest-VolumesNegativeTest-561356048-project] Calling method '>' {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:45:48.979917 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-ef5bab44-1032-4633-b398-28b0714d5c84 tempest-VolumesNegativeTest-561356048 tempest-VolumesNegativeTest-561356048-project] [instance: fe945b40-1604-4fbe-802e-31eb767fee2b] Fetching instance by UUID {{(pid=102148) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:45:48.987095 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-ef5bab44-1032-4633-b398-28b0714d5c84 tempest-VolumesNegativeTest-561356048 tempest-VolumesNegativeTest-561356048-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:45:48.987540 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-ef5bab44-1032-4633-b398-28b0714d5c84 tempest-VolumesNegativeTest-561356048 tempest-VolumesNegativeTest-561356048-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:45:48.988299 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-ef5bab44-1032-4633-b398-28b0714d5c84 tempest-VolumesNegativeTest-561356048 tempest-VolumesNegativeTest-561356048-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:45:48.988731 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-ef5bab44-1032-4633-b398-28b0714d5c84 tempest-VolumesNegativeTest-561356048 tempest-VolumesNegativeTest-561356048-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:45:49.193802 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.policy [None req-ef5bab44-1032-4633-b398-28b0714d5c84 tempest-VolumesNegativeTest-561356048 tempest-VolumesNegativeTest-561356048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c68fa38f61cb4b1693697b4e9fe7b112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e2dd96fbc344d99f55b84cf7e07a48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102148) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:45:49.202149 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-ef5bab44-1032-4633-b398-28b0714d5c84 tempest-VolumesNegativeTest-561356048 tempest-VolumesNegativeTest-561356048-project] 10.222.0.18 "GET /compute/v2.1/servers/fe945b40-1604-4fbe-802e-31eb767fee2b" status: 200 len: 1470 microversion: 2.1 time: 0.227297 Jun 24 16:45:49.202713 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 500/990] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:45:48 2022] GET /compute/v2.1/servers/fe945b40-1604-4fbe-802e-31eb767fee2b => generated 1470 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 16:45:50.220992 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-39727e50-6674-43b6-890b-31d56ec1a4ca tempest-VolumesNegativeTest-561356048 tempest-VolumesNegativeTest-561356048-project] Calling method '>' {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:45:50.221693 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-39727e50-6674-43b6-890b-31d56ec1a4ca tempest-VolumesNegativeTest-561356048 tempest-VolumesNegativeTest-561356048-project] [instance: fe945b40-1604-4fbe-802e-31eb767fee2b] Fetching instance by UUID {{(pid=102149) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:45:50.228874 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-39727e50-6674-43b6-890b-31d56ec1a4ca tempest-VolumesNegativeTest-561356048 tempest-VolumesNegativeTest-561356048-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:45:50.229323 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-39727e50-6674-43b6-890b-31d56ec1a4ca tempest-VolumesNegativeTest-561356048 tempest-VolumesNegativeTest-561356048-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:45:50.230116 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-39727e50-6674-43b6-890b-31d56ec1a4ca tempest-VolumesNegativeTest-561356048 tempest-VolumesNegativeTest-561356048-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:45:50.230552 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-39727e50-6674-43b6-890b-31d56ec1a4ca tempest-VolumesNegativeTest-561356048 tempest-VolumesNegativeTest-561356048-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:45:50.440787 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-39727e50-6674-43b6-890b-31d56ec1a4ca tempest-VolumesNegativeTest-561356048 tempest-VolumesNegativeTest-561356048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c68fa38f61cb4b1693697b4e9fe7b112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e2dd96fbc344d99f55b84cf7e07a48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:45:50.450332 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-39727e50-6674-43b6-890b-31d56ec1a4ca tempest-VolumesNegativeTest-561356048 tempest-VolumesNegativeTest-561356048-project] 10.222.0.18 "GET /compute/v2.1/servers/fe945b40-1604-4fbe-802e-31eb767fee2b" status: 200 len: 1470 microversion: 2.1 time: 0.233302 Jun 24 16:45:50.450999 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 491/991] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:45:50 2022] GET /compute/v2.1/servers/fe945b40-1604-4fbe-802e-31eb767fee2b => generated 1470 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 16:45:51.255040 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [req-694c3efe-4f1e-47c6-b716-da4fb41eeabd req-45479c45-a68b-4535-bff9-8ff19a858d74 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe945b40-1604-4fbe-802e-31eb767fee2b", "name": "network-vif-deleted", "tag": "b3f2f662-c74d-4cd3-90e7-05e63b3c5b6a"}]} {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 16:45:51.256560 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 24 16:45:51.256560 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: warnings.warn(msg) Jun 24 16:45:51.266561 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [req-694c3efe-4f1e-47c6-b716-da4fb41eeabd req-45479c45-a68b-4535-bff9-8ff19a858d74 service nova] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:45:51.267032 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [req-694c3efe-4f1e-47c6-b716-da4fb41eeabd req-45479c45-a68b-4535-bff9-8ff19a858d74 service nova] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:45:51.285106 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.compute.server_external_events [req-694c3efe-4f1e-47c6-b716-da4fb41eeabd req-45479c45-a68b-4535-bff9-8ff19a858d74 service nova] Creating event network-vif-deleted:b3f2f662-c74d-4cd3-90e7-05e63b3c5b6a for instance fe945b40-1604-4fbe-802e-31eb767fee2b on hv-cinder-84718 Jun 24 16:45:51.291034 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [req-694c3efe-4f1e-47c6-b716-da4fb41eeabd req-45479c45-a68b-4535-bff9-8ff19a858d74 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039862 Jun 24 16:45:51.292021 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 501/992] 10.222.0.18 () {64 vars in 1317 bytes} [Fri Jun 24 16:45:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 16:45:51.467304 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.api.openstack.wsgi [None req-1b73f9b5-ad52-462c-b0f3-d5c9d7c4cd7b tempest-VolumesNegativeTest-561356048 tempest-VolumesNegativeTest-561356048-project] Calling method '>' {{(pid=102149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:45:51.467908 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.compute.api [None req-1b73f9b5-ad52-462c-b0f3-d5c9d7c4cd7b tempest-VolumesNegativeTest-561356048 tempest-VolumesNegativeTest-561356048-project] [instance: fe945b40-1604-4fbe-802e-31eb767fee2b] Fetching instance by UUID {{(pid=102149) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:45:51.475300 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-1b73f9b5-ad52-462c-b0f3-d5c9d7c4cd7b tempest-VolumesNegativeTest-561356048 tempest-VolumesNegativeTest-561356048-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:45:51.475747 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-1b73f9b5-ad52-462c-b0f3-d5c9d7c4cd7b tempest-VolumesNegativeTest-561356048 tempest-VolumesNegativeTest-561356048-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:45:51.477098 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-1b73f9b5-ad52-462c-b0f3-d5c9d7c4cd7b tempest-VolumesNegativeTest-561356048 tempest-VolumesNegativeTest-561356048-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:45:51.477531 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-1b73f9b5-ad52-462c-b0f3-d5c9d7c4cd7b tempest-VolumesNegativeTest-561356048 tempest-VolumesNegativeTest-561356048-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:45:51.543804 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-1b73f9b5-ad52-462c-b0f3-d5c9d7c4cd7b tempest-VolumesNegativeTest-561356048 tempest-VolumesNegativeTest-561356048-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:45:51.544247 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG oslo_concurrency.lockutils [None req-1b73f9b5-ad52-462c-b0f3-d5c9d7c4cd7b tempest-VolumesNegativeTest-561356048 tempest-VolumesNegativeTest-561356048-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:45:51.544694 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.objects.instance [None req-1b73f9b5-ad52-462c-b0f3-d5c9d7c4cd7b tempest-VolumesNegativeTest-561356048 tempest-VolumesNegativeTest-561356048-project] Lazy-loading 'fault' on Instance uuid fe945b40-1604-4fbe-802e-31eb767fee2b {{(pid=102149) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Jun 24 16:45:51.606532 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: DEBUG nova.policy [None req-1b73f9b5-ad52-462c-b0f3-d5c9d7c4cd7b tempest-VolumesNegativeTest-561356048 tempest-VolumesNegativeTest-561356048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c68fa38f61cb4b1693697b4e9fe7b112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e2dd96fbc344d99f55b84cf7e07a48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102149) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 16:45:51.615278 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO nova.api.openstack.requestlog [None req-1b73f9b5-ad52-462c-b0f3-d5c9d7c4cd7b tempest-VolumesNegativeTest-561356048 tempest-VolumesNegativeTest-561356048-project] 10.222.0.18 "GET /compute/v2.1/servers/fe945b40-1604-4fbe-802e-31eb767fee2b" status: 200 len: 1305 microversion: 2.1 time: 0.151674 Jun 24 16:45:51.615842 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: [pid: 102149|app: 0|req: 492/993] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:45:51 2022] GET /compute/v2.1/servers/fe945b40-1604-4fbe-802e-31eb767fee2b => generated 1305 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 16:45:52.633675 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-34969277-3012-48a8-973e-a42c22df875a tempest-VolumesNegativeTest-561356048 tempest-VolumesNegativeTest-561356048-project] Calling method '>' {{(pid=102148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 16:45:52.634284 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.compute.api [None req-34969277-3012-48a8-973e-a42c22df875a tempest-VolumesNegativeTest-561356048 tempest-VolumesNegativeTest-561356048-project] [instance: fe945b40-1604-4fbe-802e-31eb767fee2b] Fetching instance by UUID {{(pid=102148) get /opt/stack/nova/nova/compute/api.py:2813}} Jun 24 16:45:52.641764 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-34969277-3012-48a8-973e-a42c22df875a tempest-VolumesNegativeTest-561356048 tempest-VolumesNegativeTest-561356048-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:45:52.642205 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-34969277-3012-48a8-973e-a42c22df875a tempest-VolumesNegativeTest-561356048 tempest-VolumesNegativeTest-561356048-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:45:52.642982 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-34969277-3012-48a8-973e-a42c22df875a tempest-VolumesNegativeTest-561356048 tempest-VolumesNegativeTest-561356048-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 24 16:45:52.643410 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG oslo_concurrency.lockutils [None req-34969277-3012-48a8-973e-a42c22df875a tempest-VolumesNegativeTest-561356048 tempest-VolumesNegativeTest-561356048-project] Lock "c009b6fd-523d-40a4-8f6f-3f0e03d98acc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 24 16:45:52.693260 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.wsgi [None req-34969277-3012-48a8-973e-a42c22df875a tempest-VolumesNegativeTest-561356048 tempest-VolumesNegativeTest-561356048-project] HTTP exception thrown: Instance fe945b40-1604-4fbe-802e-31eb767fee2b could not be found. Jun 24 16:45:52.693852 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: DEBUG nova.api.openstack.wsgi [None req-34969277-3012-48a8-973e-a42c22df875a tempest-VolumesNegativeTest-561356048 tempest-VolumesNegativeTest-561356048-project] Returning 404 to user: Instance fe945b40-1604-4fbe-802e-31eb767fee2b could not be found. {{(pid=102148) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jun 24 16:45:52.695223 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO nova.api.openstack.requestlog [None req-34969277-3012-48a8-973e-a42c22df875a tempest-VolumesNegativeTest-561356048 tempest-VolumesNegativeTest-561356048-project] 10.222.0.18 "GET /compute/v2.1/servers/fe945b40-1604-4fbe-802e-31eb767fee2b" status: 404 len: 111 microversion: 2.1 time: 0.065911 Jun 24 16:45:52.695770 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: [pid: 102148|app: 0|req: 502/994] 10.222.0.18 () {58 vars in 1235 bytes} [Fri Jun 24 16:45:52 2022] GET /compute/v2.1/servers/fe945b40-1604-4fbe-802e-31eb767fee2b => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 16:46:32.036364 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 24 16:46:32.036986 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: Fri Jun 24 16:46:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 24 16:46:38.200498 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 24 16:46:38.201083 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: Fri Jun 24 16:46:38 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 24 16:48:02.951729 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 24 16:48:02.952403 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: Fri Jun 24 16:48:02 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 24 16:48:37.431633 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 24 16:48:37.432141 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: Fri Jun 24 16:48:37 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 24 16:48:50.861302 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 24 16:48:50.861771 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: Fri Jun 24 16:48:50 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 24 16:49:52.045687 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 24 16:49:52.046285 dv-cinder-847189-3-iscsi devstack@n-api.service[102149]: Fri Jun 24 16:49:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 24 16:49:58.208431 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 24 16:49:58.209179 dv-cinder-847189-3-iscsi devstack@n-api.service[102148]: Fri Jun 24 16:49:58 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!